Top #llmops Tools & Software

Explore 2 hand-picked tools and software tagged with llmops — ranked by popularity and community signals.

Popular Trending Recent Name A-Z

litellm

github

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

AI Tools Python
★ 43,450

rig

github

⚙️🦀 Build modular and scalable LLM Applications in Rust

AI Tools Rust
★ 6,920