AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

Xunzhuo  updated a model about 1 hour ago
vllm-sr/Decision-2.0-Lux-9B
Xunzhuo  updated a model about 3 hours ago
vllm-sr/Decision-2.0-Nox-4B
Xunzhuo  updated a model about 3 hours ago
vllm-sr/Decision-2.0-Sol-2B
View all activity

Organization Card

vLLM Semantic Router — Making Intelligence Work Together