Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,939

Base only

Active filters: gguf-my-repo

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 904 • 273

mitkox/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated 8 days ago • 3.04k • 26

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 372 • 51

Szeweq/G9v3-3B-Q8_0-GGUF

Text Generation • 3B • Updated 7 days ago • 833 • 2

owao/KAT-Coder-V2.5-Dev-Q6_K-GGUF

Text Generation • 35B • Updated 7 days ago • 505 • 2

owao/KAT-Coder-V2.5-Dev-Q4_K_M-GGUF

Text Generation • 35B • Updated 7 days ago • 2.23k • 2

sugatoray/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

16B • Updated Jun 23, 2024 • 1.28k • 3

paultimothymooney/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 6.39k • 4

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 117k • 29

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 391k • 51

Kondara/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 28, 2024 • 802 • 2

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 10.4k • 51

netcat420/Qwen2.5-Coder-Scholar-7B-Abliterated-MFANN-Q5_K_M-GGUF

8B • Updated Jan 1, 2025 • 144 • 1

groonga/bge-m3-Q4_K_M-GGUF

Sentence Similarity • 0.6B • Updated Oct 1, 2025 • 947 • 2

NikolayKozloff/gemma-3-1b-it-Q8_0-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 422 • 4

sabafallah/bge-reranker-v2-m3-Q4_K_M-GGUF

Text Ranking • 0.6B • Updated Apr 2, 2025 • 43 • 1

itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF

8B • Updated Apr 19, 2025 • 100 • 1

jfiekdjdk/Qwen3-8B-abliterated-Q5_K_M-GGUF

Text Generation • 8B • Updated Apr 30, 2025 • 338 • 1

jmainformatique/DeepHat-V1-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 17, 2025 • 490 • 1

Solaren/Qwen3-MOE-6x0.6B-3.6B-Writing-On-Fire-Uncensored-Q8_0-GGUF

Text Generation • 2B • Updated Aug 27, 2025 • 540 • 10

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 39.7k • 27

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 6.49k • 12

mrgoldengun/Qwen3-4B-Q2_K-GGUF

Text Generation • 4B • Updated Oct 29, 2025 • 10 • 1

KathAhegao/Qwen3-VL-4B-Instruct-Q2_K-GGUF

Image-Text-to-Text • 4B • Updated Nov 9, 2025 • 18 • 1

bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2025 • 3.39k • 1

AXONVERTEX-AI-RESEARCH/OpenGuardrails-Text-2510-Q8_0-GGUF

Text Generation • 15B • Updated Dec 10, 2025 • 47 • 2

AXONVERTEX-AI-RESEARCH/Nemotron-Content-Safety-Reasoning-4B-Q8_0-GGUF

Text Generation • 5B • Updated Dec 10, 2025 • 37 • 1

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model

15B • Updated Jan 14 • 32 • 36

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 26 • 14

OddTheGreat/Luna_12B_V.3-Q6_K-GGUF

13B • Updated Jan 31 • 75 • 2