Top #distributed Tools & Software

tensorflow

github

An Open Source Machine Learning Framework for Everyone

redis

github

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

awesome-scalability

github

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

etcd

github

Distributed reliable key-value store for the most critical data of a distributed system

Made-With-ML

github

Learn how to develop, deploy and iterate on production-grade ML applications.

ClickHouse

github

ClickHouse® is a real-time analytics database management system

LocalAI

github

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

milvus

github

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

ray

github

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ColossalAI

github

Making large AI models cheaper, faster and more accessible

tidb

github

TiDB - the open-source, cloud-native, distributed SQL database designed for modern applications.

spacedrive

github

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

pytorch-image-models

github

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

cockroach

github

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

surrealdb

github

A scalable, distributed, collaborative, document-graph database, for the realtime web

seaweedfs

github

SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

signoz

github

SigNoz is an open-source observability platform native to OpenTelemetry with logs, traces and metrics in a single application. An open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool

handson-ml

github

⛔️ DEPRECATED – See https://github.com/ageron/handson-ml3 or handson-mlp instead.

TDengine

github

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

Paddle

github

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

ddia

github

《Designing Data-Intensive Application》DDIA 第一版 / 第二版 中文翻译

dgraph

github

high-performance graph database for real-time use cases

shardingsphere

github

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

cat

github

CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能指标、健康状况、实时告警等。