Model constellation

Every model and quantization plotted by throughput and size. Bubble size ∝ parameters. Click a point for details.

Source

Configure & deploy

Set your format, target and hardware, pick a matching model, then copy the exact download command and open its benchmark tool.

  1. 1Set constraints
  2. 2Pick a model
  3. 3Copy & run

Configure

Model