Cloud Data: Understanding 3 Common Pitfalls
This article introduces the foundational concepts of cloud and cloud data showing that it's often more than just data storage.
Join the DZone community and get the full member experience.Join For Free
The daily hype is all around you.
From private to public cloud, multi-cloud, and even hybrid cloud, you're overrun with information telling you this is the path to your digital future. To complicate matters while you are contemplating these choices, you are expected to keep up your daily tasks of enhancing customer experiences and agile delivery of those applications.
Wrapped up in all this delivery and architectural infrastructure, there's a multitude of decisions around data to be considered when engaging with any cloud experience. There are regulatory and compliance pressures that force you to evaluate how you collect, process, and store your observability data. Understanding the pitfalls around the collection, maintenance, and storage of your cloud data can mean the difference between failure and success within your cloud strategy.
This series is based on a talk given previously in Dublin, Ireland, and was brainstormed with my good friend Roel Hodzelmans. The reactions from the audience inspired me to share the concepts in this series.
Introduction to Cloud and Data
This article introduces the cloud and data we are talking about by looking closely at the decisions being made (and their effects) when monitoring your applications. Based on anonymized real-world experiences, this story highlights three top issues you need to understand as you're transitioning your data needs into any cloud environment.
When we talk about cloud here, it's anything you are using in a public cloud. This can be a single cloud user experience with just a single node, or as complex as multi-cloud providers with a vast array of nodes across many regions. The story here is not focused on your choice of public cloud usage, but on the abstract concepts of public cloud and how data impacts you directly.
Data in the cloud has many forms and it is more than just the storage of data we are talking about. It can be user data you collect on your customers, it can be data manipulated by your applications, it can be logs you want to collect, it can be metrics, or even more complex observability data.
Any time you talk about the cloud and data, it's very important to understand that the cost you least expect is the bandwidth used to transport any data in and out of your cloud environment.
As data can be in many forms, there are plenty of examples of use cases where organizations using public clouds have been confronted with devastating usage bills. Take for example this simple illustration of where an online news organization would have been devastated if they had made the choice to run their multiple news sites across several countries and languages in the cloud.Once upon a time, there was an extreme emergency in a large city that caused chaos to a point that the local government chose to lock down their citizens as their law enforcement agencies attempted to get things under control. During this lockdown that lasted over 24 hours, the citizens of this large city went online at home and crashed the local language news sites: all of them.
The Forgotten Data
In this article, I've introduced the foundational concepts of cloud and cloud data showing that it's often more than just data storage. The following article in this series will take a look at how observability in the cloud is often forgotten data.
Published at DZone with permission of Eric D. Schabell, DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.