Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a model 1 day ago

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniform

kylesayrs published a model 1 day ago

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniform

kylesayrs updated a model 1 day ago

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-uniform

View all activity

inference-optimization 's models 474

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniform

Text Generation • 23B • Updated 1 day ago • 151

inference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-uniform

Text Generation • 23B • Updated 1 day ago • 235 • 1

inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_end

2B • Updated 1 day ago • 21

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.bs8.ckp0

3B • Updated 2 days ago • 17

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 27

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 26

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 22

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 24

inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 133

inference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 134

inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8

Text Generation • 2B • Updated 2 days ago • 26

inference-optimization/Qwen3.8-27B-DSpark-Gauss-FP8-W8A8

Text Generation • 2B • Updated 2 days ago • 26

inference-optimization/Qwen3.8-27B-DSpark-FP8-DYNAMIC

Text Generation • 2B • Updated 2 days ago • 30

inference-optimization/Qwen3.8-27B-DSpark-FP8-BLOCK

Text Generation • 2B • Updated 2 days ago • 24

inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_step107505

2B • Updated 2 days ago • 24

inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 3 days ago • 24

inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 3 days ago • 22

inference-optimization/Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 3 days ago • 20

inference-optimization/Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 3 days ago • 21

inference-optimization/Qwen3-8B-DFlash-FP8-BLOCK

Text Generation • 2B • Updated 3 days ago • 21

inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.epoch1_step93171

2B • Updated 5 days ago • 42

inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC

Text Generation • 2B • Updated 6 days ago • 28

inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 6 days ago • 95

inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 6 days ago • 99

inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8

Text Generation • 1B • Updated 6 days ago • 21

inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8

Text Generation • 1B • Updated 6 days ago • 22

inference-optimization/ZAYA1-74B-preview-NVFP4

Text Generation • 75B • Updated 8 days ago • 205

inference-optimization/ZAYA1-74B-preview-NVFP4-linear

43B • Updated 8 days ago • 17

inference-optimization/Kimi-K3-0.40B-MXFP4

0.4B • Updated 12 days ago • 3.23k • 7

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt2

2B • Updated 13 days ago • 13