Hugging Face – Posts

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

All HF Hub posts

posted an update 1 day ago

Post

5429

We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.

Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source

With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.

Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch

Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.

3 replies

julien-c

posted an update 1 day ago

Post

2106

who's working on an NVFP4 version of Kimi-K3?

4 replies

Banaxi-Tech

posted an update 2 days ago

Post

7749

BananaMind 2 Pro is training!
The current checkpoint (ONLY 20% DONE) GETS #6 On the entire Open SLM Leaderboard.
We are going to release the first public preview on August 2-4 (estimated from speed)

Give us a follow to know when it releases!

4 replies

sergiopaniego

posted an update 2 days ago

Post

2705

quick reminder! 🚨

tomorrow (Tuesday, July 28), we're back with Class 3 of the Training Agents live series

🧠 what: reinforcement learning for training agents (GRPO): how it works, how to implement it in TRL, and end-to-end examples
🗓️ when: Tuesday, July 28 - 🕔 5:00 PM CEST / 8:30 PM IST
📍 where: Live on @huggingface 's X, YouTube, and LinkedIn

live: https://www.youtube.com/watch?v=ztdTed5egrM

class 1: https://x.com/SergioPaniego/status/2069382207618379813
class 2: https://x.com/SergioPaniego/status/2075180665184686187

1 reply

Enderchef

posted an update about 20 hours ago

Post

2213

Introducing GCI-Bench, Glint Research's first benchmark!

This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts.

I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M)
Pending benchmark status at OpenEvals/README#2

Glint-Research/GCI_Bench

4 replies

appvoid

posted an update 2 days ago

Post

1006

A Small Model is All You Need. Meet palmer-006 (90M)

After 3 years of experiments, we are finally releasing our flagship tiny model: **palmer-006**.

If you are building for edge hardware, SBCs (Raspberry Pi, etc.), or low-power devices, this is for you. Inspired by Andrej Karpathy's idea of a self-contained "cognitive core," we wanted to see how much power we could pack into a sub-100M parameter footprint.

🧠 **How we "Palmerized" it:**
We believe in starting our experiments with the absolute strongest baseline possible.
1. Light fine-tuning on highly curated data
2. Model merging
3. Another light fine-tuning round
4. Adjusted Mamba for maximum token speed ⚡️

⚠️ *Note: This is a foundational language model. It has not been instruction-tuned yet!*

Also, since this needs instruction tuning next to become a chat assistant—**what dataset would you recommend we use for the instruct tune?**

---
🔗 **Quick Links & Info:**

* **License:** Open for research, education, hobby, and modification! (For commercial use/hosted APIs, shoot an email to nosoyhackercodigo@gmail.com. *PS: Donators can claim a free commercial license!*)

* **Attribution:** Built using AI tech from the Technology Innovation Institute (TII).

Can't wait to see what you build at the edge. Let me know your prompt completions below! 👇

appvoid/palmer-006

9 replies

Banaxi-Tech

posted an update about 9 hours ago

Post

641

Our preview of BananaMind 2 Pro will release on August 3.
Before we do that we want to hit a goal
Lets get 150 followers on my account and 75 on BananaMind!
Me: @Banaxi-Tech
BananaMind:

BananaMind
Full Release on August 10-14
Would really appreciate it!

1 reply

owensong

posted an update 3 days ago

Post

6459

I just released Inflect v2, pushing complete TTS below 4M parameters.

Inflect-Nano-v2 fits every learned inference component, including waveform generation, into 3.96M parameters (15.97 MB FP32), making it one of the smallest publicly available complete TTS models. Inflect-Micro-v2 stays under 10M at 9.36M parameters (37.53 MB), using the extra capacity for clearer, more natural speech.

This was not about building a toy that technically produces audio. I wanted to see how much useful TTS could actually fit at this scale.

Nano stayed surprisingly close to Micro across the reported release metrics, but if you want to hear Inflect at its best, start with Micro:
owensong/Inflect-Micro-v2

Text goes in and 24 kHz speech comes out without a second learned model. Both models have PyTorch and ONNX releases: PyTorch runs on CPU or CUDA, while the browser demo runs ONNX locally through WebGPU with a WASM fallback. The Inflect code and weights are released under Apache 2.0.

Try Nano and Micro side by side:
owensong/Inflect-v2

Some people may remember the much rougher Inflect-Nano-v1 experiment. V2 was rebuilt and retrained to address its biggest weaknesses: metallic audio, unstable timing, weak prosody, and difficulty with unseen text. Nano-v2 is smaller while sounding substantially cleaner and more stable.

In an anonymous community blind test across nine voices, Micro and Nano placed second and third by normalized preference rate. Full results, samples, limitations, and inference instructions are on the model pages.

Inflect-Nano-v2:
owensong/Inflect-Nano-v2

I built Inflect independently with a limited training budget. If you test it, give it something difficult: unusual names, numbers, abbreviations, symbols, or awkward punctuation. Send me the exact text when something breaks. If you build something with it, I would genuinely love to see it.

1 reply

danielhanchen

posted an update 9 days ago

Post

4547

Introducing Unsloth for AMD 🚀
You can now train & run LLMs on your AMD hardware

• We collaborated with AMD to enable you to train & run 500+ models on AMD GPUs
• Works on Windows, WSL, Linux
• Train Qwen, Gemma on just 3GB VRAM

GitHub: https://github.com/unslothai/unsloth
Blog + Guide: https://unsloth.ai/docs/basics/amd

3 replies

SeaWolf-AI

posted an update 3 days ago

Post

6300

🖼️ POCKET-Image — the POCKET series goes visual: character-perfect text in any language, on-device

A new model in VIDRAFT's POCKET family. POCKET put 35B-class models on phones and no-GPU PCs. POCKET-Image carries the same "big capability, small hardware" idea into image generation — and fixes the one thing nearly every image model gets wrong: text.

Type "안녕하세요" into a typical model and you get "안ㅐ기." Hangul alone composes 11,172 syllable blocks; Arabic connects its letters; Thai stacks marks. Diffusion models draw scripts as shapes, so they smear. POCKET-Image renders every glyph exactly — 한국어 · 中文 · 日本語 · العربية (RTL) · ไทย · Latin and more — onto any scene you describe.

What it is:
• 100% accurate text, any language — where global models produce gibberish
• Any background from a prompt — text is optional (empty → a pure image)
• No GPU, no NPU — runs on plain CPU + RAM via the POCKET-Core engine
• Measured footprint: 8.6 GB (RTX 3050/4060) · 4.5 GB (offloaded, 6 GB cards) · 13.4 GB (MacBook, 16 GB+)
• Windows · macOS · Linux · fully local, no cloud

Built on the open, commercial-friendly Z-Image (Apache-2.0) foundation.

Honest note: the text is the guaranteed-correct part — the surrounding scene is ordinary generation, so a busy foreground can crowd the letters. We say so; clean backgrounds stay razor-sharp.

🎨 Studio — generate right here, any language:
FINAL-Bench/POCKET-Image-Studio

🧩 Model card:
FINAL-Bench/POCKET-Image-Zimage

📚 The POCKET collection:
https://huggingface.co/collections/FINAL-Bench/pocket-models

Recently active users