hi, which models are supported with this? is mobernbert and t5gemma2 on the list?
Gerald Stanje
Gerald001
Β·
AI & ML interests
None yet
Recent Activity
commentedon an article about 1 month ago
TorchNeuron: running HF models on AWS Trainium is easier than ever new activity about 1 month ago
xbill9/gemma-4-26B-A4B-it-inferentia2:infos new activity 4 months ago
openai/gpt-oss-safeguard-20b:release the BF16 weights or nvfp4Organizations
commented on TorchNeuron: running HF models on AWS Trainium is easier than ever about 1 month ago
release the BF16 weights or nvfp4
#7 opened 4 months ago
by
Gerald001
MXFP4 utilization over NVFP4
π 2
2
#121 opened over 1 year ago
by
pprovins
Inference latency
1
#24 opened 10 months ago
by
popkek00
Question about inference speed
2
#10 opened about 1 year ago
by
cX1y
I want transcription not translation
π 5
2
#29 opened 11 months ago
by
smartire
What's the best way to run this in production for online serving?
4
#45 opened 5 months ago
by
fikrikarim
Any plans for gpt oss 20b?
2
#1 opened about 1 year ago
by
andhakanoon
Eagle3 for 20b
π 1
3
#4 opened about 1 year ago
by
cr-boostrun
how to disable the reasoning mode?
π 13
11
#50 opened over 1 year ago
by
szzzzz
GGUF is very slow for some reason
2
#12 opened about 1 year ago
by
ineersa
NVIDIA L40S GPU's for MXFP4 quantization
6
#100 opened over 1 year ago
by
lordim
How to turn off thinking mode
ππ₯ 7
15
#86 opened over 1 year ago
by
Gierry
REASONING SETTING GUIDE π
ππ 4
28
#28 opened over 1 year ago
by
xbruce22
How to turn off thinking mode
ππ₯ 7
15
#86 opened over 1 year ago
by
Gierry
how to disable the reasoning mode?
π 13
11
#50 opened over 1 year ago
by
szzzzz
Update chat_template.jinja
3
#229 opened 10 months ago
by
mohsin17444
REASONING SETTING GUIDE π
ππ 4
28
#28 opened over 1 year ago
by
xbruce22
question: setting reasoning effort
6
#66 opened over 1 year ago
by
TheBigBlockPC