vLLM Semantic Router

community

https://vllm-sr.ai

Activity Feed Request to join this org

AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

Xunzhuo updated a collection about 5 hours ago

Xunzhuo published a model about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-Embedding

Xunzhuo updated a model about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-Embedding

View all activity

Organization Card

Community About org cards

One fabric. Many minds. We're introducing MoM (Mixture of Models)—a family of specialized routing models that power vLLM-SR's intelligent decision-making.

vLLM Semantic Router 👉: project link

Why MoM?

vLLM-SR solves a critical problem: how to route LLM requests to the right model at the right time. Not every query needs the same resources—"What's the weather?" shouldn't cost as much as "Analyze this legal contract."

Collections 3

View 3 collections

spaces 2

vLLM Semantic Router

Classify and analyze text for categories, PII, facts, and more

models 66

llm-semantic-router/Vela-1.0-Encoder-307M-Feedback

Text Classification • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-Reranker

Text Ranking • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-Modality

Text Classification • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-FactCheck

Text Classification • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-PII

Token Classification • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-Domain

Text Classification • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M

Fill-Mask • 0.3B • Updated about 5 hours ago

llm-semantic-router/Vela-1.0-Encoder-307M-Embedding

Sentence Similarity • 0.3B • Updated about 5 hours ago

llm-semantic-router/elephant-embeddings-v1-text-small

Sentence Similarity • 0.3B • Updated May 14 • 1.2k • 1

llm-semantic-router/multi-modal-embed-small

Sentence Similarity • 0.3B • Updated May 12 • 4.91k • • 24

datasets 13

llm-semantic-router/modality-routing-dataset

Viewer • Updated Mar 20 • 5.04k • 36

llm-semantic-router/mlcommons-ai-safety-synth

Viewer • Updated Jan 23 • 12k • 67 • 1

llm-semantic-router/fact-check-classification-dataset

Viewer • Updated Jan 22 • 22.3k • 149 • 2

llm-semantic-router/jailbreak-detection-dataset

Viewer • Updated Jan 21 • 4.13k • 247 • 4

llm-semantic-router/feedback-detector-dataset

Viewer • Updated Jan 21 • 20.9k • 128 • 1

llm-semantic-router/halueval-llm-spans

Viewer • Updated Jan 10 • 10k • 43

llm-semantic-router/e2e-halspans

Viewer • Updated Jan 10 • 1.5k • 14

llm-semantic-router/dart-halspans

Viewer • Updated Jan 10 • 2k • 17

llm-semantic-router/halueval-spans

Viewer • Updated Jan 9 • 10k • 39 • 1

llm-semantic-router/longcontext-haldetect

Viewer • Updated Jan 9 • 800 • 135

View 13 datasets