Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,048

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 2 days ago • 3.34M • 2.19k

Cactus-Compute/needle3

Text Generation • Updated 8 days ago • 85.4k • 249

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 5 days ago • 59.3k • 391

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 2.2M • 927

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 16 days ago • 767k • 1.69k

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 16 days ago • 231k • 331

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 10 days ago • 63.2k • 150

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 27 days ago • 639k • • 1.4k

FINAL-Bench/POCKET-Zimage-CPU

Text-to-Image • 6B • Updated 3 days ago • 76 • 42

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 10 days ago • 32.7k • 83

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 434k • 876

ganmoor-ai-labs/finanalyzer-indian-bank-statements

Text Generation • 2B • Updated 9 days ago • 543 • 12

chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF

Text Classification • 0.8B • Updated 1 day ago • 944 • 9

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.1M • 257

FINAL-Bench/POCKET-Qwen3.8-Flash-Next-GGUF

Text Generation • 177B • Updated 3 days ago • 164 • 51

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated Aug 17 • 536k • 1.15k

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.09M • 201

Cactus-Compute/needle2

Text Generation • Updated 25 days ago • 24k • 328

Abiray/MiniCPM5-2B-heretic-abliterated-GGUF

Text Generation • 3B • Updated 20 days ago • 23.9k • 33

oddadmix/Kokoro-7M-Distill

Text-to-Speech • Updated 11 days ago • 597 • 32

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 371k • 161

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 28.5k • 972

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 118k • 787

desert-ant-labs/redact

Token Classification • Updated 4 days ago • 7.28k • 24

desert-ant-labs/voz

Automatic Speech Recognition • Updated 4 days ago • 227 • 42

openbmb/MiniCPM5-2B-MLX

Text Generation • 3B • Updated 16 days ago • 194k • 51

bartowski/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 18 days ago • 21.6k • 34

chaoliangUNSW/Jev-Style-0.8B-Decision-v3

Text Classification • 0.8B • Updated about 10 hours ago • 188 • 4

jsbaicenter/Aztec-Coder-4B

Text Generation • 4B • Updated about 6 hours ago • 685 • 4

desert-ant-labs/clear

Audio-to-Audio • Updated 4 days ago • 1.6k • 27