llm Tools

llama_index

github

LlamaIndex is the leading document agent and OCR platform

Made-With-ML

github

Learn how to develop, deploy and iterate on production-grade ML applications.

mempalace

github

The best-benchmarked open-source AI memory system. And it's free.

LocalAI

github

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

litellm

github

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

jan

github

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

ray

github

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

BettaFish

github

微舆：人人可用的多Agent舆情分析助手，打破信息茧房，还原舆情原貌，预测未来走向，辅助决策！从0实现，不依赖任何框架。

nanobot

github

"🐈 nanobot: The Ultra-Lightweight Personal AI Agent"

ChatTTS

github

A generative speech model for daily dialogue.

mindsdb

github

Query Engine for AI Analytics: Build self-reasoning agents across all your live data

hello-agents

github

📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程

langextract

github

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

rtk

github

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

khoj

github

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

ai-engineering-hub

github

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

Vane

github

Vane is an AI-powered answering engine.

tabby

github

Self-hosted AI coding assistant

LightRAG

github

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

caveman

github

🪨 why use many token when few token do trick — Claude Code skill that cuts 65% of tokens by talking like caveman

continue

github

⏩ Source-controlled AI checks, enforceable in CI. Powered by the open-source Continue CLI

graphrag

github

A modular graph-based Retrieval-Augmented Generation (RAG) system

self-llm

github

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

daily_stock_analysis

github

LLM驱动的 A/H/美股智能分析器：多数据源行情 + 实时新闻 + LLM决策仪表盘 + 多渠道推送，零成本定时运行，纯白嫖. LLM-powered stock analysis system for A/H/US markets.