Load Balancing and Traffic Management Questions

Distributing requests across capacity: load-balancing algorithms (round-robin, least-connections, consistent hashing), L4 versus L7 balancing, health checks, and traffic shaping. Covers sticky sessions, canary and blue-green routing, rate limiting, and graceful draining. The traffic-distribution layer that keeps a scaled system balanced and available.

HardSystem Design
41 practiced

Design an automated control loop that shifts a percentage of production traffic to a canary over a fixed window and rolls back automatically on an SLO breach. Cover how you would smooth the weight changes, what guardrails you'd set (minimum observation windows, maximum error thresholds), and how the rollback itself executes quickly and safely.

MediumTechnical
41 practiced

Compare consistent hashing and rendezvous (highest-random-weight) hashing. How does each handle node addition and removal, what is the cost of rebalancing, and which would you use for cache routing versus partitioned storage with heterogeneous node weights?

EasyTechnical
36 practiced

You manage a pool of stateless web servers behind a single load balancer that sees bursty traffic and heterogeneous server capacity. Compare round robin, least connections, and weighted load balancing for this situation: how does each pick a server, and which would you choose?

MediumTechnical
46 practiced

Implement a thread-safe least-connections scheduler. Provide addBackend(id), removeBackend(id), incConn(id), decConn(id), and selectBackend(), where selectBackend() returns the backend with the fewest active connections and ties are broken deterministically. Describe your concurrency strategy, its complexity, and how you would handle backends with very different capacities so the busiest small backend isn't starved.

EasyTechnical
39 practiced

Why are load balancers used in distributed systems? Describe at least four distinct problems they solve, and how they contribute to horizontal scaling, availability, and fault isolation. Where would you typically place load balancers in a three-tier architecture (edge, internal service, service-to-service)?

Unlock Full Question Bank

Get access to all Load Balancing and Traffic Management interview questions and detailed answers.

Sign in to Continue

Join thousands of developers preparing for their dream job.