DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
What's in store for DevOps in 2023? Hear from the experts in our "DZone 2023 Preview: DevOps Edition" on Fri, Jan 27!
Save your seat

The Square Root Staffing Law

More than just for staffing, the law also tells you how many more servers you need to meet increased demand.

Baron Schwartz user avatar by
Baron Schwartz
·
Nov. 02, 16 · Opinion
Like (2)
Save
Tweet
Share
4.25K Views

Join the DZone community and get the full member experience.

Join For Free

the square root staffing law is a rule of thumb derived from queueing theory, useful for getting an estimate of the capacity you might need to serve an increased amount of traffic.

square root staffing law

the square root staffing law is designed to help with capacity planning in what’s called the qed regime, which tries to balance efficiency with quality of service. capacity planning is a set of tradeoffs: for best quality of service, you must provision lots of spare capacity (headroom), but that’s wasteful. for best efficiency, you minimize idle capacity, but then quality of service becomes terrible.

the qed regime poses the following scenario: assuming that your current quality of service is acceptable, and you want to maintain it, how much must you increase capacity to serve increased demand?

the picture above illustrates this. suppose you currently have 10 servers (the green circle) and your peak utilization is 25% (the blue circle), so you have 75% idle capacity (the green area). you predict that you’ll need to serve 3x the current peak load for, say, black friday. how many more servers do you need?

the answer is less than a linear increase to 30 servers (the red dashed line). it’s 21, in fact (the orange circle). this answer comes from the rule of thumb that to hold quality of service constant, you must increase the headroom by the square root of the load increase.

if you’d like to experiment interactively with this capacity planning tool, i built a desmos calculator for you. you can drag the circles around to see how parameters such as utilization affect the amount of idle capacity you’ll need to provision.

the square root rule is an approximation, but it’s a decent one, and its bounds are well understood. to learn more about this, please read my book the essential guide to queueing theory , which contains further reference material you might also find helpful.

you might also be interested in learning about the universal scalability law , which is a great tool for capacity planning as well.

Law (stochastic processes)

Published at DZone with permission of Baron Schwartz, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Why Every Fintech Company Needs DevOps
  • Kotlin Is More Fun Than Java And This Is a Big Deal
  • Unlocking the Power of Polymorphism in JavaScript: A Deep Dive
  • Last Chance To Take the DZone 2023 DevOps Survey and Win $250! [Closes on 1/25 at 8 AM]

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: