vllm

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

github AI Tools Python free
★ 76,801Stars
15,657Forks
76,801Watchers
4Views
Apr 2026Last Update
View on GitHub →

About vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Related Tools

openclaw

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

★ 358,294 typescript github

Python

All Algorithms implemented in Python

★ 219,641 python github

tensorflow

An Open Source Machine Learning Framework for Everyone

★ 194,753 cpp github

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

★ 183,466 python github

ollama

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

★ 169,269 go github

stable-diffusion-webui

Stable Diffusion web UI

★ 162,378 python github