Show N/A for unmeasured TPOT/TTFT and hide all-N/A columns
Jonna Marie Matthiesen+1: Claude Opus 4.6
c73bd71
- Replace ttft=0.00 and tpot with N/A in Llama-3.2, Gemma-3, and Qwen3
text benchmarks where these metrics were not actually measured
- Update CSV parser to preserve N/A as a string
- Hide metric columns from table and chart when all values are N/A
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
Jonna Marie Matthiesen+1: Claude Opus 4.6
7671b7c
- Add accuracy CSVs for Llama-3.2, Gemma-3, and Qwen3 (baseline vs FlashHead)
- Add RTX 3500 Ada TPS-only latency data for all families with README measurements
- Add Gemma-3-270M RTX 3500 Ada data (first latency data for this variant)
- Register rtx_3500_ada device in config with experiment setup
- Fix deriveBaseFamily regex to match M (million) suffixes so Gemma-3-270M
groups under Gemma-3 in the sidebar
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add Llama-3.2, Gemma-3, and Qwen3 benchmarks and improve chart rendering
Jonna Marie Matthiesen+1: Claude Opus 4.6 (1M context)
b96722d
Add benchmark data for three new model families (Llama-3.2, Gemma-3,
Qwen3) on NVIDIA edge devices using vLLM 0.19.0. Improve chart/table
UX by sorting bars by model size, hiding all-zero metrics, prefixing
labels when multiple families are shown, and supporting configurable
base display names.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
