AI Tools · llm Tools

onyx

github

Open Source AI Platform - AI Chat with advanced features that works with every LLM

FastGPT

github

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

semantic-kernel

github

Integrate cutting-edge LLM technology quickly and easily into your apps

prompt-optimizer

github

An AI prompt optimizer for writing better prompts and getting better AI results.

RAG_Techniques

github

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

sglang

github

SGLang is a high-performance serving framework for large language models and multimodal models.

gpt-researcher

github

An autonomous agent that conducts deep research on any data using any LLM providers

SillyTavern

github

LLM Frontend for Power Users.

langfuse

github

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

agenticSeek

github

Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity. 🔔 Official updates only via twitter @Martin993886460 (Beware of fake account)

PageIndex

github

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

mlflow

github

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Hands-On-Large-Language-Models

github

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

haystack

github

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

llmfit

github

Hundreds of models & providers. One command to find what runs on your hardware.

strix

github

Open-source AI hackers to find and fix your app’s vulnerabilities.

agentscope

github

Build and run agents you can see, understand and trust.

llm-action

github

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

toon

github

🎒 Token-Oriented Object Notation (TOON) – Compact, human-readable, schema-aware JSON for LLM prompts. Spec, benchmarks, TypeScript SDK.

llm-cookbook

github

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

openai-agents-python

github

A lightweight, powerful framework for multi-agent workflows

ai

github

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

pandas-ai

github

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

Scrapegraph-ai

github

Python scraper based on AI