• Blog Content
  • About Burns and This Blog
  • To the Hackers and Script Kiddies
  • SE Skills Survey – Help!!

Eric Burns Online

My Virtual Take on Tech

  • Blog Content
  • About Burns and This Blog
  • To the Hackers and Script Kiddies
  • SE Skills Survey – Help!!

When a 2% Increase in Cache Hit Rate Can Save You 20% in Data Center Costs

February 19, 2021 Analytics CDNs High Level Tech Intro No Comments

One of the key differences with Fastly is the ability to Cache the Uncacheable. You can programmatically purging content so fast that we even have customers caching API read calls.  The cache holds onto content longer rather than passing to origin on “uncacheable” content.

When the data changes, your system makes an API call to Fastly to purge of what changed.  Purges remove content from the Cache with a 150ms mean purge time.  This is great for those items you know will change, but don’t know when.  Other CDNs try to tell you this is “dynamic content” and that they won’t cache it because they can’t purge it fast enough.  Items like inventory quantities, sporting game scores and flight arrival times.  Why hammer your origin with every one of these requests?  Instead cache and purge globally when it changes.

Visibility & Control

Even if you don’t decide to cache “event driven content”, Fastly’s visibility and control allows you to tune and watch your CHR near real time.  Made a mistake and your CHR dropped?  Roll back to your prior configuration, with a mean global deploy time of 13 seconds.  You now have time to relax and figure out a different tune.

Deploying configurations with other CDNs globally can take hours.  And if the logging takes 4 plus hours to get to you, any mistake can make for hours of damage.  An hour or two to deploy, several hours to get log summaries, and then once you’ve figured out you did something wrong – you now have hours for the fixed configuration to deploy.

Small Changes

But what happens if your tuning only gets you a 2% increase? From the overall picture of total traffic it might not seem like much. But from the Data Center (your “origin”) it could create tremendous cost savings.

Take for example the following scenario. A firm has a 90% cache hit rate with their existing legacy CDN. These examples and charts are for illustration purposes only, but the math proves itself out.  The view of the overall content being sent out is:

But take this from the view of inside the Data Center. The 10% not being cached is basically 100% of the work/traffic the Data Center is seeing:

Remember – this traffic is content served by servers that you have to power, cool, and maintain. There is often software licensing involved and IT hours to support. This is a real cost, real money already being spent.

What Does It All Mean?

So what does that 2% increase in CHR (Cache Hit Rate) look like? From the overall data being served, it really doesn’t look like much. The small red bar below is that 2% overall increase, additional content being served by the CDN:

 

But from the Data Center the impact is huge. The 2% increase in caching can translate into  a 20% reduction in the traffic hitting your Data Center:

What if you could go from 60% cached to 80%? A 50% reduction at the Data Center!  Do the math . . . it’s pretty impressive. Even going from 90% cached to 91% could possibly offset the CDN costs. You’d be giving your end users better performance while at the same time freeing up valuable resources in the Data Center.

If you are thinking of selecting (or changing to) a modern CDN you need to rethink how you quantify ROI. A modern CDN can improve your End User Experience and also make your IT Staff very happy . . . and save you some serious $$$.

Note from the editor:  These are the views and opinions of Eric Burns.  They are not those of Fastly, its staff, investors or stock holders

How to Include a Raspberry Pi in a Remote Demo - Part 1

Slackware, Still Very Much Alive

Leave a Reply Cancel reply

Recent Posts
  • Always On Culture and Global Teams
  • Google Dorking Against the Competition
  • API Guides Are Not Textbooks, Don’t Expect Your Users To Use Them That Way
  • ECHOGEAR Open Rack
  • Getting RAID Inside a Dell
Categories
  • Analytics
  • Attitude
  • CDNs
  • Conversational AI
  • Creative Projects
  • Gear
  • Getting Hired
  • High Level Tech Intro
  • Hiring Process
  • Message/Chat/Collaboration
  • Monitoring
  • Random Notes
  • Raspberry Pi
  • Sales Engineers
  • SE Skills
  • Startups
  • Uncategorized
Recent Comments
  • Peter Cohan on The Best Conference Demo
  • E Berry on Do You Know About These Female Trail Blazers?
Meta
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org
Archives
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021
  • May 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
Proudly powered by WordPress | Theme: Doo by ThemeVS.