esc
  • Jump to
  • New on Zivvi
  • Top rated on Zivvi
  • Built with AI tools
  • Browse categories
  • Surprise meOpen a random app
  • Launch your app
  • Toggle dark mode
vLLM logo

vLLM

Serve large language models with high throughput and efficiency.

Open sourceWeb
Visit

Preview

  • Website preview · vllm.ai

vLLM screenshot 1
Website preview of vllm.ai · 1 / 1

About vLLM

vLLM is an open-source inference and serving engine for large language models. It helps deploy AI models faster by optimizing throughput and memory efficiency for developers.

Popularity

#12,296

worldwide today

44%over 40 days

Best #11,360 on Nov 1

Sep 28Source: Tranco top sites listNov 6
#179 most popular in Developer Tools · of 292 ranked on ZivviSee rankings

Ratings & reviews

No reviews yet

Tried vLLM? Your take helps the next person decide — and makes you the first.

vLLM alternatives

See all →

vLLM FAQ

What is vLLM?

vLLM is an open-source inference and serving engine for large language models. It helps deploy AI models faster by optimizing throughput and memory efficiency for developers.

Is vLLM free?

vLLM is open source, so you can self-host it for free. Check vllm.ai for hosted plans.

What platforms does vLLM support?

vLLM is available on Web.

What are the best vLLM alternatives?

Popular alternatives to vLLM in Developer Tools include Vast.ai, ImageMagick, LLVM, Sanity, and Herdr. Compare them side by side on Zivvi.