Top #llama Tools & Software

AutoGPT

github

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

ollama

github

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui

github

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

vllm

github

A high-throughput and memory-efficient inference and serving engine for LLMs

LlamaFactory

github

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

unsloth

github

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.5, DeepSeek, gpt-oss locally.

llama_index

github

LlamaIndex is the leading document agent and OCR platform

LocalAI

github

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

khoj

github

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

AstrBot

github

AI Agent Assistant that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

fish-speech

github

SOTA Open Source TTS

k8sgpt

github

Giving Kubernetes Superpowers to everyone