Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

704

Base only

Active filters: sglang

Soomin33/Qwen3.8-Flash-Next-FP6-INT8

Text Generation • 98B • Updated 25 days ago • 199 • 4

HaberstrohSystems/Qwen3.8-Flash-Next-int2-mixed-AutoRound-24GB-SGLang

Text Generation • 11B • Updated 24 days ago • 635 • 7

Anbeeld/Ling-3.0-flash-DSpark-GGUF

Text Generation • 1.0B • Updated 21 days ago • 702 • 1

tencent/Simple-Attention-Sparsification

Text Generation • Updated 14 days ago • 8

zenlm/zen6

Text Generation • 18B • Updated 7 days ago • 242 • 1

igor255/Qwen3.8-27B-DFlash2-EXL3-4.00bpw

Text Generation • 0.6B • Updated 7 days ago • 195 • 1

cbert33/Agnes-3.0-Flash-FP8-Calibrated

Image-Text-to-Text • 33B • Updated 4 days ago • 17 • 1

mradermacher/Qwen3.8-27B-Uncensored-Mythos-Class-Agentic-i1-GGUF

27B • Updated 2 days ago • 2.12k • 1

superagent-ai/security-one-27b

Text Classification • 27B • Updated 1 day ago • 1

kaushikvira/Qwen3.8-27B-thinkingcap-NVFP4-HF

Image-Text-to-Text • 15B • Updated 1 day ago • 11 • 1

Blackfrost-AI/MiMo-V2.6-Flash-MOPD-Derisking-Intervention-Runtime

Text Generation • Updated about 3 hours ago • 1

voska/GLM-5.3-Flash-Uncensored-W4A16

Image-Text-to-Text • 321B • Updated 11 days ago • 781 • 4

SurfaceData/llava-v1.6-mistral-7b-sglang

Image-Text-to-Text • 8B • Updated Mar 7, 2024 • 11 • 9

SurfaceData/llava-v1.6-vicuna-7b-sglang

Image-Text-to-Text • 7B • Updated Mar 7, 2024 • 11 • 1

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • 73B • Updated May 12, 2025 • 68 • 2

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • 69B • Updated May 12, 2025 • 71

alvarobartt/grok-2-tokenizer

Updated Aug 27, 2025 • 3

unsloth/grok-2

Text Generation • Updated Sep 6, 2025 • 43 • 5

lemuralabs/MiniMax-M2-Pruned-25

173B • Updated Aug 5 • 464 • 36

mradermacher/MiniMax-M2-THRIFT-GGUF

Updated Aug 26 • 3

JasmineBBB/Kimi-Linear-48B-A3B-Instruct-bnb-4bit

Text Generation • 49B • Updated Nov 5, 2025 • 39 • 1

mradermacher/MiniMax-M2-THRIFT-i1-GGUF

173B • Updated Aug 26 • 365 • 10

bartowski/VibeStudio_MiniMax-M2-THRIFT-GGUF

Text Generation • 173B • Updated Nov 20, 2025 • 1.62k • 9

lemuralabs/MiniMax-M2-Pruned-55

106B • Updated Aug 5 • 89 • 5

JinnP/SGLang-EAGLE3-Qwen3-Coder-30B-A3B-Instruct

Text Generation • 0.2B • Updated Nov 25, 2025 • 172 • 2

mradermacher/MiniMax-M2-THRIFT-55-GGUF

106B • Updated Aug 17 • 132 • 2

mradermacher/MiniMax-M2-THRIFT-55-i1-GGUF

106B • Updated Aug 17 • 1.05k • 2

Doradus-AI/MiroThinker-v1.0-30B-FP8

Text Generation • 31B • Updated Dec 5, 2025 • 30 • 4

Doradus-AI/Hermes-4.3-36B-FP8

Text Generation • 36B • Updated Dec 7, 2025 • 534 • 5

Doradus-AI/RnJ-1-Instruct-FP8

Text Generation • 9B • Updated Dec 7, 2025 • 94 • 5