Scaling Glossary

Browse 31 scaling terms defined in plain English, from the cultural dictionary of computing.

31 Scaling Terms

Auto-scaling Group
Auto-scaling Group (ASG) is a cloud infrastructure feature that automatically adjusts the number of compute instances (virtual machines or containers) in a...
Compute Optimal Training
A training regime chosen to get the best model quality for a fixed compute budget by balancing model size and data volume appropriately.
Consistent Hashing
A hashing technique where adding or removing a node only requires redistributing 1/n of the keys (where n is the number of nodes), compared to traditional...
CQRS
Command Query Responsibility Segregation — separating the read model (queries/views) from the write model (commands/mutations). Commands validate and modify...
Distributed Cache
A Distributed Cache is a development concept used to shape how software is built, executed, or maintained in real systems. Developers rely on it to make code...
Distributed Consensus
A Distributed Consensus is a development concept used to shape how software is built, executed, or maintained in real systems. Developers rely on it to make...
Distributed Hash Table
A Distributed Hash Table is a development concept used to shape how software is built, executed, or maintained in real systems. Developers rely on it to make...
Distributed Lock
A Distributed Lock is a development concept used to shape how software is built, executed, or maintained in real systems. Developers rely on it to make code...
Distributed Queue
A Distributed Queue is a development concept used to shape how software is built, executed, or maintained in real systems. Developers rely on it to make code...
Distributed System Design
A Distributed System Design is a development concept used to shape how software is built, executed, or maintained in real systems. Developers rely on it to...
Dunbar's Number
The theoretical cognitive limit (~150) on the number of stable social relationships a human can maintain. In tech organizations, explains why communication...
Emergent Behavior AI
Unexpected or non-explicitly programmed behavior that appears as AI systems grow in scale or are combined with new workflows.
Growing Pains
The awkward problems that appear as a system, team, or product scales beyond its original assumptions. In engineering slang, growing pains are normal, but...
Growth Stage
The phase of a company after initial validation, when the focus shifts toward scaling revenue, teams, and systems in a repeatable way. Growth-stage companies...
Horizontal Scaling
Adding more machines to a system to handle increased load, distributing work across a fleet. The opposite of vertical scaling (making one machine bigger)....
Hypergrowth
An extreme phase of rapid company expansion across revenue, headcount, and operations, often faster than internal systems can comfortably support. Hypergrowth...
Lateral Scaling
Another term for horizontal scaling — increasing system capacity by adding more machines or instances to distribute load, rather than upgrading the hardware of...
Linear Growth
Growth that increases by roughly the same absolute amount each period rather than compounding. In startup settings, linear growth is often less attractive than...
Load Balancer
A load balancer is a device or piece of software that distributes incoming network traffic across multiple servers to ensure no single server becomes...
Mixture of Experts
A neural network architecture that routes different inputs to different specialized sub-networks (experts), activating only a subset for each input. Allows...
Operating Leverage
The ability of a business to grow revenue faster than operating costs, improving margins as scale increases. Software investors care deeply about operating...
Partitioning
Splitting a large table into smaller, more manageable pieces (partitions) based on a key — typically date (range partitioning), category (list partitioning),...
Ramp Up
To increase gradually in speed, volume, staffing, or familiarity over time. In engineering slang, ramp-up language appears around systems, traffic, team...
Rapid Growth
A phase where users, revenue, or operations are expanding quickly enough to strain existing systems and assumptions. Rapid growth is exciting, but it often...
Read Replica
A read-only copy of a primary database that receives replicated writes asynchronously (or semi-synchronously), allowing read traffic to be distributed across...
Right Sizing
Adjusting resources, scope, or architecture to better fit actual needs rather than assumptions. In engineering slang, right-sizing is often the boring but...
rollup
A layer-2 scaling solution that executes transactions off-chain but posts compressed transaction data (or validity proofs) back to the main chain. Optimistic...
sharding key
The column or value used to determine which shard (partition) of a distributed database stores a given row. Choosing the right sharding key is one of the most...
sidechain
An independent blockchain that runs parallel to a main chain (layer 1), connected by a two-way bridge that allows assets to move between them. Sidechains can...
Vertical Scaling
Vertical Scaling (also called scaling up) is the approach of increasing a system's capacity by adding more resources to a single machine, such as more CPU...
Web Scale
A phrase used seriously or mockingly to describe systems built for very large internet-scale traffic. In engineering slang, web scale often carries skepticism...

Related Topics