Sign inPlan my launch
Launches

vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

About

High-throughput and memory-efficient inference and serving engine for Large Language Models. Deploy AI faster with state-of-the-art performance.

Made by
vllm-project
Category
AI agents & assistants
Built
Open source
Stage
Live
Licence
Apache-2.0
GitHub
★ 96.6k · updated 4d ago
Curated by LaunchWoo

We added this from the product's public website. Is it yours? Claim it to edit the listing, set your launch date or remove it.

Claim this listing