James smith's picture

James smith

goodluck-03301
路

AI & ML interests

None yet

Recent Activity

repliedto kalyan-ks's post 42 minutes ago
NandiBERT >> IndicBERTv2, ModernBERT and Ettin Encoder NandiBERT - 饾悗饾惄饾悶饾惂 饾悞饾悗饾悡饾悁 饾悇饾惂饾悳饾惃饾悵饾悶饾惈 饾悓饾惃饾悵饾悶饾惀 饾悷饾惃饾惈 饾悎饾惂饾悵饾悽饾悮饾惂 饾悑饾悮饾惂饾悹饾惍饾悮饾悹饾悶饾惉 NandiBERT, SOTA Encoder model for Indian languages which is - SOTA for Indic languages outperforming IndicBERT v2 - among the best for English language outperforming Ettin Encoder and ModernBERT models. 饾悐饾悶饾惒 饾悈饾悶饾悮饾惌饾惍饾惈饾悶饾惉 饾惃饾悷 饾悕饾悮饾惂饾悵饾悽饾悂饾悇饾悜饾悡 [1] Multilingual Encoder : A single model supporting English and 11 Indian languages like Hindi, Telugu, Tamil etc. [2] Two Model Sizes : Available in two sizes namely NandiBERT-150M and NandiBERT-450M [3] Bidirectional Transformer Architecture: Uses bidirectional attention so that every token can attend to every other input token [4] Long Context: NandiBERT-150M supports 16K context and NandiBERT-450M supports 32K context [5] Large Vocabulary: Uses 100,352 vocabulary shared across languages [6] SOTA Performance: Outperforms IndicBERT v2 (for Indic languages) and ModernBERT, Ettin Encoder (for English language) [7] Open Weights and License: Models weights are available on HF platform. NandiBERT-150M: https://huggingface.co/FrontiersMind/NandiBERT-150M NandiBERT-450M: https://huggingface.co/FrontiersMind/NandiBERT-450M
View all activity

Organizations

None yet