Top #gateway Tools & Software

litellm

github

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

kong

github

🦍 The API and AI Gateway

go-zero

github

A cloud-native Go microservices framework with cli tool for productivity.

consul

github

Consul is a distributed, highly available, and data center aware solution to connect and configure applications across dynamic, distributed infrastructure.

new-api

github

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. 🍥

SafeLine

github

SafeLine is a self-hosted WAF(Web Application Firewall) / reverse proxy to protect your web apps from attacks and exploits.

shardingsphere

github

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

apisix

github

The Cloud-Native API Gateway and AI Gateway

solution-architecture-patterns

github

Reusable, vendor-neutral, industry-specific, vendor-specific solution architecture patterns for enterprise

express-gateway

github

A microservices API Gateway built on top of Express.js