Jonna Marie Matthiesen
Claude Opus 4.6
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
7671b7c Download data/acc-Gemma-3.csv from embedl/Edge-Inference-Benchmarks: direct link, hf CLI and curl.
- Browser
- Download file 145 Bytes
-
https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks/resolve/main/data/acc-Gemma-3.csv
- Command line
-
hf download hf://spaces/embedl/Edge-Inference-Benchmarks/data/acc-Gemma-3.csv
-
curl -L -o acc-Gemma-3.csv https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks/resolve/main/data/acc-Gemma-3.csv
145 Bytes
| Model,MMLU-Pro,IFEval,BBH,TruthfulQA,GSM8K | |
| google/gemma-3-1b-it,0.15,0.55,0.38,0.31,0.42 | |
| embedl/gemma-3-1b-it-FlashHead,0.15,0.49,0.38,0.31,0.39 | |