Instructions to use prithivMLmods/tiny-voca-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use prithivMLmods/tiny-voca-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf prithivMLmods/tiny-voca-GGUF:Q4_K_M --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf prithivMLmods/tiny-voca-GGUF:Q4_K_M --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf prithivMLmods/tiny-voca-GGUF:Q4_K_M --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use prithivMLmods/tiny-voca-GGUF with Ollama:
ollama run hf.co/prithivMLmods/tiny-voca-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use prithivMLmods/tiny-voca-GGUF with Docker Model Runner:
docker model run hf.co/prithivMLmods/tiny-voca-GGUF:Q4_K_M
- Lemonade
How to use prithivMLmods/tiny-voca-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull prithivMLmods/tiny-voca-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.tiny-voca-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
tiny-voca-GGUF
tiny-voca is an ultra-lightweight, open-source (Apache-2.0) English text-to-speech (TTS) model created by Muhammed Nazeem (
n4ze3m) that packs its entire architectureβincluding waveform generationβinto just 4.54 million parameters (~18.2 MB in PyTorch or ~21.4 MB in ONNX). Trained from scratch in under 8 hours on a single RTX 4090 (costing $9.56 total) using 17.6 hours of synthetic speech generated by Qwen3-TTS, it converts text to phonemes via the customdizionephonemizer and uses transformer encoders paired with a fast source-filter synthesizer rather than a heavy neural vocoder to output 24 kHz mono audio. Supporting two fixed American English voices (F2 female and M2 male) with adjustable speed, pitch shift, and pitch range, it runs roughly 70x faster than real time on four CPU threadsβmaking it ideal for client-side browser or mobile deploymentβand achieves competitive intelligibility (ranking 8th and 13th on the November 2026 Open TTS Leaderboard with sub-0.8% average Word Error Rate), though it lacks streaming, voice cloning, and prosody variation.
Model Files
| File Name | Quant Type | File Size | File Link | Description |
|---|---|---|---|---|
| tiny-voca.F32.gguf | F32 | 6.42 MB | Link | Full 32-bit float weights. Maximum precision, largest file size. |
| tiny-voca.BF16.gguf | BF16 | 3.28 MB | Link | Full BF16 weights. High quality, excellent balance of precision and size. |
| tiny-voca.Q3_K_L.gguf | Q3_K_L | 1.12 MB | Link | Lower quality but usable, good for very low RAM availability. |
| tiny-voca.Q3_K_M.gguf | Q3_K_M | 1.07 MB | Link | Low quality, smallest file size. |
| tiny-voca.Q4_K_M.gguf | Q4_K_M | 1.29 MB | Link | Good quality, default size for most use cases, recommended. |
| tiny-voca.Q4_K_S.gguf | Q4_K_S | 1.18 MB | Link | Slightly lower quality with more space savings, recommended. |
| tiny-voca.Q5_K_M.gguf | Q5_K_M | 1.37 MB | Link | High quality, recommended. |
| tiny-voca.Q5_K_S.gguf | Q5_K_S | 1.27 MB | Link | High quality with slight space savings, recommended. |
| tiny-voca.Q6_K.gguf | Q6_K | 1.76 MB | Link | Very high quality, near perfect, recommended. |
| tiny-voca.Q8_0.gguf | Q8_0 | 1.8 MB | Link | Extremely high quality, generally unneeded but max available standard quant. |
| tiny-voca.mmproj-bf16.gguf | mmproj-bf16 | 8.14 MB | Link | Multimodal projection file in BF16 format. Used for audio/voice capabilities. |
llama.cpp
LLM inference in C/C++ β https://github.com/ggml-org/llama.cpp
Quantized using llama.cpp by prithivMLmods.
- Downloads last month
- -
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
32-bit
Model tree for prithivMLmods/tiny-voca-GGUF
Base model
n4ze3m/tiny-voca