Database Sharding in System Design

What Is Database Sharding Database Sharding represents a fundamental horizontal scaling technique in system design that divides a single large database into multiple smaller, independent shards . Each shard operates as a complete, self-contained database instance hosted on separate servers or nodes , holding only a specific subset of the overall data. This architectural approach enables distributed databases to handle massive volumes of data and traffic that would overwhelm any single database server . The core principle of sharding relies on a deliberate data partitioning strategy where the application layer or a dedicated shard router determines which shard should store or retrieve any given record. Unlike vertical scaling , which simply upgrades hardware on one machine, database sharding distributes both storage and compute resources across many machines, delivering linear scalability while maintaining high availability and fault isolation . Why Organizations Adopt Database Sharding