a family of on-device MoE language models with sub-billion active parameters (0.3-0.9B active and 1.3-5.3B total) that establish a new Pareto frontier
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding
Skaling: Chinchilla's Exponents Meet Kaplan's Coupling
spaces 55
pinned
Running on CPU Upgrade
Agents
36
FAIR Chemistry Leaderboard
🥇
Submit and evaluate chemistry model predictions
pinned
Running on Zero
Agents
Featured
5.1k
MusicGen
🎵
Generate music from a text description and optional melody
pinned
Running on Zero
Agents
166
MelodyFlow
🎵
Generate music from text and optional melody
pinned
Running on Zero
Agents
Featured
116
ActionMesh
🎬
Generate animated 3D meshes from video
pinned
Runtime error
Agents
Featured
279
CoTracker
🎨
Track points in a video
Running on CPU Upgrade
Agents
70
FAIR Chem UMA Demo
⚛
Run molecular dynamics or relaxation simulations with UMA
models 2,359
facebook/VGGT-Omega
Updated • 381
facebook/MobileMoE-L-QAT
Text Generation • 3B • Updated • 64 • 8
facebook/MobileMoE-M-QAT
Text Generation • 1B • Updated • 56 • 5
facebook/MobileMoE-S-QAT
Text Generation • 0.7B • Updated • 349 • 7
facebook/MobileMoE-L-SFT
Text Generation • 5B • Updated • 30 • 3
facebook/MobileMoE-M-SFT
Text Generation • 3B • Updated • 90 • 2
facebook/MobileMoE-S-SFT
Text Generation • 1B • Updated • 246 • 5
facebook/MobileMoE-L-Base
Text Generation • 5B • Updated • 48 • 7
facebook/MobileMoE-M-Base
Text Generation • 3B • Updated • 164 • 6
facebook/MobileMoE-S-Base
Text Generation • 1B • Updated • 114 • 14
datasets 124
facebook/show3d-dataset
Viewer • Updated • 2.14k • 20.6k • 7
facebook/uco3d
Updated • 122k • 12
facebook/wearable-ai
Viewer • Updated • 2.1k • 3.49k • 26
facebook/WearableQA
Viewer • Updated • 20.4k • 587 • 15
facebook/omnilingual-gaia2-results
Preview • Updated • 676
facebook/omnilingual-gaia2
Viewer • Updated • 6.4k • 498 • 2
facebook/mmi
Viewer • Updated • 893 • 79 • 7
facebook/GAMUT
Viewer • Updated • 3.62k • 155 • 1
facebook/r3d-bench
Viewer • Updated • 1.72M • 220 • 4
facebook/S-EMBER
Viewer • Updated • 18.9k • 3.52k • 6