"Laptops can't run AI" has this supposedly "local lm expert" guy ever heard of LM Studio before
🌌 Vega thingies.
CNWPlayer
CNWPlayer
AI & ML interests
SLMs, LLMs, really anything that ends in LM.
Recent Activity
repliedto Banaxi-Tech's post about 21 hours ago
Hi everyone
We at https://huggingface.co/saicr have found a very interesting "thing" we call ADN via interpretabillity. It appears on EVERY prompt sent to the model. More on that later.
Also I made a X account follow it for more updates:
@banaxitech
And KleinML:
@kleinmlai
Here's my website for Klein ML: https://kleinml.com/?ref=huggingface.co
reacted to danielhanchen's post with 🔥 about 24 hours ago
Run DeepSeek V4.1-Flash-1017 locally! 🐳
We made 1-bit retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).
Run on a 128GB+ RAM device. V4.1 Flash 1017 is the strongest open model to date
Guide: https://unsloth.ai/docs/models/deepseek-v4.1-flash
GGUF: https://huggingface.co/unsloth/DeepSeek-V4.1-Flash-1017-GGUFOrganizations
None yet
replied to Banaxi-Tech's post about 21 hours ago
reacted to danielhanchen's post with 🔥 about 24 hours ago
Post
4,236
Run DeepSeek V4.1-Flash-1017 locally! 🐳
We made 1-bit retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).
Run on a 128GB+ RAM device. V4.1 Flash 1017 is the strongest open model to date
Guide: https://unsloth.ai/docs/models/deepseek-v4.1-flash
GGUF: unsloth/DeepSeek-V4.1-Flash-1017-GGUF
We made 1-bit retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).
Run on a 128GB+ RAM device. V4.1 Flash 1017 is the strongest open model to date
Guide: https://unsloth.ai/docs/models/deepseek-v4.1-flash
GGUF: unsloth/DeepSeek-V4.1-Flash-1017-GGUF
liked a
model 2 days ago
Wait nvm you already did it?!
liked a
model 3 days ago
LFM 24B A2B soon?
liked a
model 4 days ago
Idea: Add instruct/chat leaderboard
2
#234 opened 6 days ago
by CNWPlayer
updated a
model 7 days ago
replied to wayneworkman2012's post 8 days ago
mfw i dont have 192 bajillabytes of hbm69420 ram and would rather take fp8 glm 5.3 over iq4_xs Qwen 3.6 35ba3b
reacted to Banaxi-Tech's post with 👍 8 days ago
Post
4,218
Should I even continue making models?
- 27 replies
published a
model 9 days ago
Can we get a GGUF?
3
#7 opened 9 days ago
by 
sol-frigate
reacted to Banaxi-Tech's post with 🚀🔥 11 days ago
Post
4,692
Well GPT X3 takes the lead. As of right now.
We are now announcing BananaMind 3 🍌! (not ai for those emoji guys)
All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.
I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!
BananaMind 3 may also be partnered with dot labs.
We will cancel BananaMind 2.1 and BananaMind 2 Ultra.
As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 😟)
We are now announcing BananaMind 3 🍌! (not ai for those emoji guys)
All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.
I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!
BananaMind 3 may also be partnered with dot labs.
We will cancel BananaMind 2.1 and BananaMind 2 Ultra.
As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 😟)
- 12 replies
liked a
model 11 days ago
updated a
model 15 days ago
reacted to danielhanchen's post with 👀😎 15 days ago
Post
4,059
Google releases EmbeddingGemma 2, a new open embedding model that runs locally on 0.5GB RAM.
The 740M parameter Apache 2.0 model combines a 270M text model with vision (170M) + audio (300M).
Run & train the model via Unsloth.
GGUF: unsloth/embeddinggemma-2-GGUF
Guide: https://unsloth.ai/docs/models/embeddinggemma-2
The 740M parameter Apache 2.0 model combines a 270M text model with vision (170M) + audio (300M).
Run & train the model via Unsloth.
GGUF: unsloth/embeddinggemma-2-GGUF
Guide: https://unsloth.ai/docs/models/embeddinggemma-2