vLLM
High-throughput serving for open-weight models.
Why us on this
Serves self-hosted models on the client's own GPU, with the throughput a team of users needs.
More in AI models
The other tools we reach for on the same kind of work.
OpenAI GPTOpenAI
OpenAI's large language models, used through the API.
Runs open-weight language models on your own hardware.
GemmaGoogle
Google's open-weight language models, run on-premise.
Anthropic's Claude models, used through the API and in our own engineering.
Google GeminiGoogle
Google's multimodal models, strong on long documents and images.
Alibaba's open-weight model family, from small to very large.
xAI's Grok models, available through an API.
Capable open-weight general and reasoning models.
Talk to us
Already running vLLM?
Tell us what it is doing today and where it stops. We will say plainly whether we can move it, what that takes, and when it is the wrong tool for what you are trying to do.
