appvoid/palmer-006
Text Generation • 91.1M • Updated • 60 • 9
🤏 pico mode
appvoid
appvoid
AI & ML interests
Working on small sota models
Recent Activity
reacted to FredyRivera-dev's post with 🚀 38 minutes ago
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute. posted an update about 2 hours ago
i love reinforcement learning updated a model about 4 hours ago
appvoid/palmer-006Organizations
appvoid/a-cool-model
Text Generation • 0.4B • Updated • 208 • 2
appvoid/cloud-11
Text Generation • 0.4B • Updated • 391
appvoid/cloud-10
Text Generation • 0.4B • Updated • 389
appvoid/cloud-09
Text Generation • 0.4B • Updated • 389
appvoid/cloud-08
Text Generation • 0.4B • Updated • 400
appvoid/cloud-06
Text Generation • 0.4B • Updated • 401
appvoid/cloud-05
Text Generation • 0.4B • Updated • 409
appvoid/appvoid-cloud-04-q8_0-GGUF
0.4B • Updated • 102
appvoid/cloud-04
Text Generation • 0.4B • Updated • 399
appvoid/appvoid-cloud-03-q8_0-GGUF
0.4B • Updated • 104
appvoid/cloud-03
Text Generation • 0.4B • Updated • 395
appvoid/appvoid-cloud-02-q8_0-GGUF
0.4B • Updated • 101
appvoid/cloud-02
Text Generation • 0.4B • Updated • 398
appvoid/appvoid-palmer-005-core-q8_0-GGUF
Text Generation • 0.4B • Updated • 129 • 1
appvoid/appvoid-cloud-7-q8_0-GGUF
0.4B • Updated • 143
appvoid/appvoid-cloud-6-q8_0-GGUF
0.4B • Updated • 128
appvoid/cloud-6
Text Generation • 0.4B • Updated • 108
appvoid/appvoid-cloud-5-q8_0-GGUF
0.4B • Updated • 125
appvoid/cloud-5
Text Generation • 0.4B • Updated • 111
appvoid/appvoid-cloud-3-q8_0-GGUF
0.4B • Updated • 125
appvoid/cloud-3
Text Generation • 0.4B • Updated • 117
appvoid/appvoid-cloud-4-q8_0-GGUF
0.4B • Updated • 116
appvoid/cloud-4
Text Generation • 0.4B • Updated • 124
appvoid/appvoid-cloud-2-q8_0-GGUF
0.4B • Updated • 115
appvoid/appvoid-cloud-1-q8_0-GGUF
0.4B • Updated • 128
appvoid/cloud-2
Text Generation • 0.4B • Updated • 200
appvoid/palmer-005-core
Text Generation • 0.4B • Updated • 71 • 1
appvoid/palmer-005-plus-preview
Text Generation • 1B • Updated • 10
appvoid/palmer-005
Text Generation • 91.1M • Updated • 187 • 4