Top #llm-inference Tools & Software

Explore 2 hand-picked tools and software tagged with llm-inference — ranked by popularity and community signals.

Popular Trending Recent Name A-Z

ray

github

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

AI Tools Python
★ 42,145

llm-action

github

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

AI Tools
★ 24,152