Last Update
Model constellation
Every model and quantization plotted by throughput and size. Bubble size ∝ parameters. Click a point for details.
Source
Configure & deploy
Set your format, target and hardware, pick a matching model, then copy the exact download command and open its benchmark tool.
- 1Set constraints
- 2Pick a model
- 3Copy & run
Configure
Model