view post Post 2708 The best quality public GGUFs and experimental MLX inference for open LLMs!Collection: https://huggingface.co/collections/TheStageAI/edge-lm See translation 🤗 4 4 + Reply
view post Post 3227 Kimi K3 can now be run locally! ✨The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.GGUF: unsloth/Kimi-K3-GGUFGuide: https://unsloth.ai/docs/models/kimi-k3 See translation 5 replies · ❤️ 11 11 🔥 8 8 👍 3 3 + Reply