Scaling / 03
Why can more servers still be slow?
Take one API offline, watch traffic reroute, and compare failure headroom with four and five instances under the same load.
- Incoming load
- 1,100 req/s
- Healthy APIs
- 4 / 4
- Headroom
- 100 req/s
System capacity1,200 req/s
min(4 × 300, 1,200)
Illustration · 100 req/s per dotPreparing the 3D walkthrough
Request / slowedResponse / doneProbe failed / excessSelect a component
API A healthy · receiving traffic