Top 100 scalability Repositories
Ranking
| Ranking | Project Name | Stars | Forks | Language | Open Issues | Description | Last Commit |
|---|---|---|---|---|---|---|---|
| 1 | system-design-primer | 356,139 | 57,039 | Python | 259 | Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards. | 2026-03-20 |
| 2 | firecrawl | 144,482 | 8,320 | TypeScript | 47 | The API to search, scrape, and interact with the web at scale. 🔥 | 2026-07-04 |
| 3 | whisper | 104,191 | 12,698 | Python | 0 | Robust Speech Recognition via Large-Scale Weak Supervision | 2026-04-15 |
| 4 | nest | 76,023 | 8,325 | TypeScript | 10 | A progressive Node.js framework for building efficient, scalable, and enterprise-grade server-side applications with TypeScript/JavaScript 🚀 | 2026-07-04 |
| 5 | awesome-scalability | 72,218 | 7,034 | - | 0 | The Patterns of Scalable, Reliable, and Performant Large-Scale Systems | 2026-01-04 |
| 6 | Scrapling | 68,097 | 6,742 | Python | 0 | 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! | 2026-07-04 |
| 7 | gatsby | 55,946 | 10,170 | JavaScript | 217 | React-based framework with performance, scalability, and security built in. | 2026-07-03 |
| 8 | penpot | 54,987 | 3,591 | Clojure | 614 | Penpot: The open-source design platform for Product teams that need scalable collaboration. | 2026-07-04 |
| 9 | professional-programming | 51,217 | 3,997 | Python | 1 | A collection of learning resources for curious software engineers | 2026-06-29 |
| 10 | serverless | 46,911 | 5,729 | JavaScript | 1111 | ⚡ Serverless Framework – Effortlessly build apps that auto-scale, incur zero costs when idle, and require minimal maintenance using AWS Lambda and other managed cloud services. | 2026-07-02 |
| 11 | milvus | 45,073 | 4,107 | Go | 742 | Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search | 2026-07-04 |
| 12 | system-design | 44,358 | 5,767 | - | 2 | Learn how to design systems at scale and prepare for system design interviews | 2026-04-02 |
| 13 | spark | 43,558 | 29,270 | Scala | 50 | Apache Spark - A unified analytics engine for large-scale data processing | 2026-07-04 |
| 14 | awesome-system-design-resources | 39,353 | 8,433 | Java | 8 | Learn System Design concepts and prepare for interviews using free resources. | 2026-02-16 |
| 15 | MPAndroidChart | 38,199 | 8,994 | Java | 2067 | A powerful 🚀 Android chart view / graph view library, supporting line- bar- pie- radar- bubble- and candlestick charts as well as scaling, panning and animations. | 2025-06-05 |
| 16 | bulletproof-react | 35,462 | 3,230 | TypeScript | 37 | 🛡️ ⚛️ A simple, scalable, and powerful architecture for building production ready React applications. | 2026-05-14 |
| 17 | seaweedfs | 33,302 | 2,891 | Go | 662 | SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling. | 2026-07-04 |
| 18 | qdrant | 32,942 | 2,455 | Rust | 456 | Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/ | 2026-07-04 |
| 19 | surrealdb | 32,613 | 1,290 | Rust | 614 | A scalable, distributed, collaborative, document-graph database, for the realtime web | 2026-06-30 |
| 20 | BetterDisplay | 32,488 | 613 | - | 207 | Unlock your displays on your Mac! Flexible HiDPI scaling, XDR/HDR extra brightness, virtual screens, DDC control, extra dimming, PIP/streaming, EDID override and lots more! | 2026-06-16 |
| 21 | cockroach | 32,249 | 4,064 | Go | 7032 | CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement. | 2026-07-03 |
| 22 | influxdb | 31,609 | 3,716 | Rust | 2054 | Scalable datastore for metrics, events, and real-time analytics | 2026-07-02 |
| 23 | jitsi-meet | 29,542 | 7,949 | TypeScript | 80 | Jitsi Meet - Secure, Simple and Scalable Video Conferences that you use as a standalone app or embed in your web application. | 2026-07-03 |
| 24 | react-boilerplate | 29,493 | 6,026 | JavaScript | 86 | 🔥 A highly scalable, offline-first foundation with the best developer experience and a focus on performance and best practices. | 2023-03-23 |
| 25 | nx | 29,037 | 2,755 | TypeScript | 342 | The Monorepo Platform that amplifies both developers and AI agents. Nx optimizes your builds, scales your CI, and fixes failed PRs automatically. Ship in half the time. | 2026-07-04 |
| 26 | xgboost | 28,528 | 8,878 | C++ | 399 | Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow | 2026-07-04 |
| 27 | mobx | 28,191 | 1,801 | TypeScript | 49 | Simple, scalable state management. | 2026-06-25 |
| 28 | supermemory | 28,161 | 2,431 | TypeScript | 11 | Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era. | 2026-07-05 |
| 29 | locust | 27,964 | 3,221 | Python | 10 | Write scalable load tests in plain Python 🚗💨 | 2026-07-01 |
| 30 | elixir | 26,559 | 3,491 | Elixir | 20 | Elixir is a dynamic, functional language for building scalable and maintainable applications | 2026-07-03 |
| 31 | system-design-academy | 26,491 | 3,401 | - | 0 | If you want to become good at AI & system design, join this newsletter 👇 | 2026-07-02 |
| 32 | haystack | 25,825 | 2,902 | MDX | 71 | Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, m... | 2026-07-03 |
| 33 | bazel | 25,576 | 4,528 | Java | 1591 | a fast, scalable, multi-language and extensible build system | 2026-07-03 |
| 34 | TDengine | 24,954 | 5,012 | C | 402 | High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios | 2026-07-04 |
| 35 | electron-react-boilerplate | 24,243 | 3,983 | TypeScript | 176 | A Foundation for Scalable Cross-Platform Apps | 2026-04-29 |
| 36 | Paddle | 24,009 | 6,009 | C++ | 997 | PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署） | 2026-07-04 |
| 37 | neon | 22,454 | 1,014 | Rust | 288 | Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero. | 2026-05-25 |
| 38 | unilm | 22,155 | 2,701 | Python | 643 | Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities | 2026-01-23 |
| 39 | gleam | 21,621 | 987 | Rust | 171 | ⭐️ A friendly language for building type-safe, scalable systems! | 2026-07-03 |
| 40 | graal | 21,621 | 1,794 | Java | 670 | GraalVM compiles applications into native executables that start instantly, scale fast, and use fewer compute resources 🚀 | 2026-07-04 |
| 41 | vitess | 21,094 | 2,367 | Go | 916 | Vitess is a database clustering system for horizontal scaling of MySQL. | 2026-07-04 |
| 42 | shardingsphere | 20,747 | 6,892 | Java | 282 | Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases. | 2026-07-05 |
| 43 | awesome-production-machine-learning | 20,687 | 2,583 | - | 8 | A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning | 2026-07-03 |
| 44 | system-design-resources | 18,288 | 2,469 | - | 1 | These are the best resources for System Design on the Internet | 2025-07-16 |
| 45 | sealos | 18,260 | 2,467 | TypeScript | 44 | Sealos is an AI-native Cloud Operating System that unifies the entire application lifecycle, from development in cloud IDEs to production deployment and management. It is perfect for building and scal... | 2026-07-03 |
| 46 | ml-engineering | 18,239 | 1,159 | Python | 1 | Machine Learning Engineering Open Book | 2026-07-01 |
| 47 | Speech | 17,716 | 3,489 | Python | 90 | A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech) | 2026-07-04 |
| 48 | nebula | 17,487 | 1,157 | Go | 52 | A scalable overlay networking tool with a focus on performance, simplicity and security | 2026-07-03 |
| 49 | hydra | 17,379 | 1,586 | Go | 104 | Internet-scale OpenID Certified™ OpenID Connect and OAuth2.1 provider that integrates with your user management through headless APIs. Solve OIDC/OAuth2 user cases over night. Consume as a service on ... | 2026-07-04 |
| 50 | camel | 17,324 | 1,980 | Python | 217 | 🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org | 2026-06-28 |
| 51 | httprouter | 17,136 | 1,460 | Go | 61 | A high performance HTTP request router that scales well | 2024-07-22 |
| 52 | Megatron-LM | 16,955 | 4,175 | Python | 370 | Ongoing research training transformer models at scale | 2026-07-05 |
| 53 | nomad | 16,683 | 2,110 | Go | 1521 | Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and sc... | 2026-07-03 |
| 54 | mcp-for-beginners | 16,680 | 5,440 | Jupyter Notebook | 0 | This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for... | 2026-07-03 |
| 55 | fabric | 16,676 | 9,121 | Go | 183 | Hyperledger Fabric is an enterprise-grade permissioned distributed ledger framework for developing solutions and applications. Its modular and versatile design satisfies a broad range of industry use ... | 2026-07-02 |
| 56 | docs | 16,640 | 599 | Python | 351 | Docs is an open-source text editor: web-native, made for real-time collaboration, cleanly structured documents and sub-documents with full ownership of your data. Built to scale with Django and React. | 2026-07-03 |
| 57 | Wan2.2 | 16,525 | 2,054 | Python | 243 | Wan: Open and Advanced Large-Scale Video Generative Models | 2026-03-17 |
| 58 | weaviate | 16,496 | 1,334 | Go | 386 | Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a c... | 2026-07-05 |
| 59 | emqx | 16,466 | 2,531 | Erlang | 190 | The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles | 2026-07-04 |
| 60 | Wan2.1 | 16,458 | 2,940 | Python | 328 | Wan: Open and Advanced Large-Scale Video Generative Models | 2026-03-05 |
| 61 | amplication | 16,014 | 1,549 | TypeScript | 609 | Amplication brings order to the chaos of large-scale software development by creating Golden Paths for developers - streamlined workflows that drive consistency, enable high-quality code practices, si... | 2026-06-30 |
| 62 | lowcode-engine | 15,878 | 2,739 | TypeScript | 654 | An enterprise-class low-code technology stack with scale-out design / 一套面向扩展设计的企业级低代码技术体系 | 2025-03-10 |
| 63 | zephyr | 15,806 | 9,487 | C | 2253 | Primary Git Repository for the Zephyr Project. Zephyr is a new generation, scalable, optimized, secure RTOS for multiple hardware architectures. | 2026-07-05 |
| 64 | answer | 15,583 | 1,331 | Go | 93 | A Q&A platform software for teams at any scales. Whether it's a community forum, help center, or knowledge management platform, you can always count on Apache Answer. | 2026-07-03 |
| 65 | salt | 15,538 | 5,598 | Python | 1642 | Software to automate the management and configuration of infrastructure and applications at scale. | 2026-07-05 |
| 66 | caprover | 15,080 | 983 | TypeScript | 174 | Scalable PaaS (automated Docker+nginx) - aka Heroku on Steroids | 2026-05-18 |
| 67 | solana | 14,928 | 5,744 | Rust | 265 | Web-Scale Blockchain for fast, secure, scalable, decentralized apps and marketplaces. | 2025-01-22 |
| 68 | pytest | 14,306 | 3,216 | Python | 843 | The pytest framework makes it easy to write small tests, yet scales to support complex functional testing | 2026-07-05 |
| 69 | Hunyuan3D-2 | 14,083 | 1,454 | Python | 223 | High-Resolution 3D Assets Generation with Large Scale Hunyuan3D Diffusion Models. | 2025-10-28 |
| 70 | pinpoint | 13,840 | 3,757 | Java | 469 | APM, (Application Performance Management) tool for large-scale distributed systems. | 2026-07-03 |
| 71 | kratos | 13,737 | 1,166 | Go | 148 | Headless cloud-native authentication and identity management written in Go. Scales to a billion+ users. Replace Homegrown, Auth0, Okta, Firebase with better UX and DX. Passkeys, Social Sign In, OIDC, ... | 2026-07-03 |
| 72 | litgpt | 13,462 | 1,467 | Python | 234 | 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. | 2026-06-29 |
| 73 | stalwart | 13,461 | 811 | Rust | 63 | All-in-one Mail & Collaboration server. Secure, scalable and fluent in every protocol (IMAP, JMAP, SMTP, CalDAV, CardDAV, WebDAV). | 2026-07-04 |
| 74 | awesome-sre | 13,303 | 1,762 | - | 51 | A curated list of Site Reliability and Production Engineering resources. | 2025-08-28 |
| 75 | codis | 13,224 | 2,657 | Go | 286 | Proxy based Redis cluster solution supporting pipeline and scaling dynamically | 2024-04-15 |
| 76 | core | 13,108 | 844 | TypeScript | 175 | A toolchain for building scalable, enterprise-ready component systems on top of TypeScript and Web Component standards. Stencil components can be distributed natively to React, Angular, Vue, (+ more) ... | 2026-07-04 |
| 77 | TRELLIS | 13,087 | 1,264 | Python | 236 | Official repo for paper "Structured 3D Latents for Scalable and Versatile 3D Generation" (CVPR'25 Spotlight). | 2026-06-26 |
| 78 | nakama | 12,830 | 1,435 | Go | 89 | Scalable open-source game backend server: multiplayer, matchmaking, leaderboards, chat, and social features for games. | 2026-07-02 |
| 79 | clip-as-service | 12,828 | 2,069 | Python | 290 | 🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP | 2024-01-23 |
| 80 | nebula | 12,257 | 1,320 | C++ | 639 | A distributed, fast open-source graph database featuring horizontal scalability and high availability | 2026-05-18 |
| 81 | mean | 12,055 | 3,367 | TypeScript | 9 | The MEAN stack uses Mongo, Express, Angular(6) and Node for simple and scalable fullstack js applications | 2026-02-17 |
| 82 | garnet | 11,895 | 669 | C# | 25 | Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication feature... | 2026-07-04 |
| 83 | kepler.gl | 11,888 | 1,947 | TypeScript | 451 | Kepler.gl is a powerful open source geospatial analysis tool for large-scale data sets. | 2026-07-05 |
| 84 | pomelo | 11,879 | 2,866 | JavaScript | 135 | A fast,scalable,distributed game server framework for Node.js. | 2023-08-10 |
| 85 | webmagic | 11,680 | 4,125 | Java | 337 | A scalable web crawler framework for Java. | 2025-12-20 |
| 86 | vue-storefront | 10,932 | 2,076 | - | 36 | Alokai is a Frontend as a Service solution that simplifies composable commerce. It connects all the technologies needed to build and deploy fast & scalable ecommerce frontends. It guides merchants to ... | 2026-06-09 |
| 87 | moveable | 10,725 | 658 | TypeScript | 449 | Moveable! Draggable! Resizable! Scalable! Rotatable! Warpable! Pinchable! Groupable! Snappable! | 2024-06-03 |
| 88 | unopim | 10,552 | 153 | PHP | 19 | Unopim is a free and open-source Laravel-based Product Information Management (PIM) system that helps businesses manage and enrich product data from a single platform. Built to scale beyond 10M+ produ... | 2026-07-03 |
| 89 | centrifugo | 10,472 | 713 | Go | 20 | Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever. | 2026-07-04 |
| 90 | modin | 10,389 | 674 | Python | 674 | Modin: Scale your Pandas workflows by changing a single line of code | 2026-02-10 |
| 91 | keda | 10,341 | 1,455 | Go | 203 | KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes | 2026-07-01 |
| 92 | skypilot | 10,255 | 1,129 | Python | 115 | Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem). | 2026-07-05 |
| 93 | open-code-review | 9,922 | 650 | Go | 19 | Open-source & free — Battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in fine-tuned ruleset (NPE, thread-... | 2026-07-04 |
| 94 | nlp_chinese_corpus | 9,903 | 1,554 | - | 22 | 大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP | 2026-02-06 |
| 95 | cassandra | 9,800 | 3,900 | Java | 0 | Open source transactional distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure without compromising performance. | 2026-07-03 |
| 96 | falcon | 9,797 | 1,006 | Python | 148 | The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale. | 2026-07-01 |
| 97 | OpenRLHF | 9,738 | 975 | Python | 298 | An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL) | 2026-06-17 |
| 98 | terragrunt | 9,690 | 1,210 | Go | 132 | Terragrunt is a flexible orchestration tool that allows Infrastructure as Code written in OpenTofu/Terraform to scale. | 2026-07-03 |
| 99 | oneflow | 9,409 | 1,013 | C++ | 465 | OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient. | 2025-12-04 |
| 100 | cadence | 9,364 | 898 | Go | 125 | Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way. | 2026-07-03 |