Hugging Face's logo
ryan carson's picture

ryan carson

Carson1391
1 1
mmrobiulislam's profile picture
·

AI & ML interests

None yet

Recent Activity

repliedto Hoglet-33's post 1 day ago
Everything going on here at basically AI: 1. Pebble 1.5 We're working on Pebble 1.5. Here's what we know so far: - They will be better than the last generation. 99.99% certain. - Expanded context lengths of at least 16,384 tokens, with the flagship potentially reaching 32,768. - A Mamba3-based architecture with some other new architectural designs we're experimenting with. - Native CPU compatibility — something we failed at with the last generation. - Natively multilingual and multimodal??? 2. SmolCodeBench A code benchmark designed specifically for small models, because there really isn't a good one right now. 3. SENTRY VOID is working on something called SENTRY — System for Evaluating Neural Threats, Responses, and Yields. More on that soon. 4. basically OS It's an operating system/app/harness. We're still deciding. 5. Finances Trying to balance the finances after purchasing a Hugging Face Pro subscription. Follow us for updates: @Hoglet-33 https://huggingface.co/basically-ai https://huggingface.co/basically-experimental https://huggingface.co/void-research
reacted to Hoglet-33's post with 🔥 1 day ago
Everything going on here at basically AI: 1. Pebble 1.5 We're working on Pebble 1.5. Here's what we know so far: - They will be better than the last generation. 99.99% certain. - Expanded context lengths of at least 16,384 tokens, with the flagship potentially reaching 32,768. - A Mamba3-based architecture with some other new architectural designs we're experimenting with. - Native CPU compatibility — something we failed at with the last generation. - Natively multilingual and multimodal??? 2. SmolCodeBench A code benchmark designed specifically for small models, because there really isn't a good one right now. 3. SENTRY VOID is working on something called SENTRY — System for Evaluating Neural Threats, Responses, and Yields. More on that soon. 4. basically OS It's an operating system/app/harness. We're still deciding. 5. Finances Trying to balance the finances after purchasing a Hugging Face Pro subscription. Follow us for updates: @Hoglet-33 https://huggingface.co/basically-ai https://huggingface.co/basically-experimental https://huggingface.co/void-research
repliedto Hoglet-33's post 23 days ago
Pebble-25M and Pebble-25M-Chat are out now! We’re excited to release Pebble-25M and Pebble-25M-Chat! Both models use our 3:1 Mamba2/Transformer hybrid architecture and were pretrained on 25B tokens. Pebble-25M-Chat was then further fine-tuned on an additional 250M tokens from smol-smoltalk, following the same approach used for the Pebble-10M models. We hope you enjoy experimenting with them! Pebble-50M is coming in a few days. Models Pebble-25M: https://huggingface.co/basically-ai/Pebble-25M Pebble-25M-Chat: https://huggingface.co/basically-ai/Pebble-25M-Chat Pebble-10M GGUFs In case you missed it, our friend @ContextReq made GGUF versions of the Pebble-10M models: https://huggingface.co/ContextReq/Pebble-10M-GGUF https://huggingface.co/ContextReq/Pebble-10M-Chat-GGUF Follow us if you don’t want to miss future releases and updates! @Hoglet-33 https://huggingface.co/basically-ai https://huggingface.co/basically-experimental
View all activity

Organizations

None yet