Top #llama Tools & Software

AutoGPT

github

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

ollama

github

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui

github

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

vllm

github

A high-throughput and memory-efficient inference and serving engine for LLMs

LlamaFactory

github

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

unsloth

github

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.5, DeepSeek, gpt-oss locally.

anything-llm

github

The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.

llama_index

github

LlamaIndex is the leading document agent and OCR platform

LocalAI

github

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

jan

github

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

khoj

github

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

self-llm

github

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

AstrBot

github

AI Agent Assistant that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

fish-speech

github

SOTA Open Source TTS

RAG_Techniques

github

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

sglang

github

SGLang is a high-performance serving framework for large language models and multimodal models.

langfuse

github

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Awesome-Chinese-LLM

github

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

free-llm-api-resources

github

A list of free LLM inference resources accessible via API.

MaxKB

github

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

deepwiki-open

github

Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme

meetily

github

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.

shell_gpt

github

A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

llama-gpt

github

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!