DZone
Performance Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > Performance Zone > Why Logs Matter

Why Logs Matter

Should you invest in redundancy or should you invest in providers that already have the redundancy to protect your data and reduce your downtime?

Tom Smith user avatar by
Tom Smith
CORE ·
Mar. 18, 17 · Performance Zone · Opinion
Like (1)
Save
Tweet
7.68K Views

Join the DZone community and get the full member experience.

Join For Free

It was great speaking with Manoj Chaudhary, CTO and V.P. of Engineering at Loggly, about the Amazon Web Services S3 outage on February 28 that crippled portions of the internet for up to five hours for DZone, Expedia, Medium, Slack, and other major sites.

While Loggly is completely cloud-based, it runs on a hybrid cloud with its own data center, as well as on AWS. Loggly mines log data in real-time and reveals what matters to write better quality code and deliver a great user experience (UX).

All Loggly logs were available during the S3 outage. The volume of logs for some customers was up three to four times more than average daily volume during the outage, ranging from 10 Mbps to 40 to 50 Mbps.

This indicates the need for companies, regardless of their log provider, to ensure that they have the necessary room in compute and storage to handle the increase in data during these spikes. 

After three hours, S3 began operating normally and the load gradually decreased as servers came back online. By the fifth hour, everything was back to normal.

Loggly earned a great deal of trust with their customers as a result of the outage since they saw that Loggly was not affected during the outage and was able to maintain a view into what was happening across the web. 

While redundancy is expensive, it is part of Loggly's business model. Should you invest in redundancy or in providers that already have the redundancy to protect your data and reduce your downtime?

Amazon Web Services

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Getting Started With RSocket Kotlin
  • Introduction to JWT (Also JWS, JWE, JWA, JWK)
  • Making Your Own Express Middleware
  • API Security Weekly: Issue 165

Comments

Performance Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo