Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

DevOps Open-Source Monitoring Tools Can Reduce Cost and Increase Uptime

DZone's Guide to

DevOps Open-Source Monitoring Tools Can Reduce Cost and Increase Uptime

Using open source tools that follow the DevOps model of cultural shifting can dramatically reduce your DevOps pipeline.

· Open Source Zone ·
Free Resource

DON’T STRESS! Assess your OSS. Get your free code scanner from FlexeraFlexNet Code Aware scans Java, NuGet, and NPM packages.

-Recent progress in the open source world of DevOps tools can help enterprises reduce costs and increase uptime.  They key thing is for managers to know how to choose and implement tools.

Break Down Siloes of Data

Look for tools that support the core DevOps cultural shift, which is the cultural bias to working collaboratively. In the modern enterprise, we often have very siloed data and information, and monitoring tools should help bring that data together. DevOps engineers using the right tools can make sure that data is shared not just with the ops team, but the dev team and the business team. IT managers need a report that's generated from the same data that goes to the business. With the right tools managers have a real-time report that goes to the business, the dev teams, and the ops teams so that they are all looking at the same data at the same time.

This reduces the time needed to resolve issues. It eliminates the problem of having the network teams, development teams and database teams looking at different data and not immediately seeing where a problem lies. The right tools can ensure that they're all looking at the same screen, and shows the same red dots in the same places. That cuts down on long conversations and incident calls.

That's just the basics. Some tools are integrating business data into that same platform including Tweets. For example, if all of a sudden, there's a spike in Twitter users going, "Hey, I can't access...", the tech team can see that.  No one is looking at that today, and it’s a key performance metric for customer services. It's a good indicator of a problem.

Some of the really big players already offer these types of tools, including HP and IBM, but they are pricey and sometimes require commitments to other parts of the vendor’s platform.  Sometimes it may require a team of five people just to maintain the system. This is sometimes unacceptable to a mid-size organization.

What many mid-size organizations, and some larger enterprises, are opting for is an open source tool that fits right on top of the ELK stack. It's built on top of something that's open-sourced so it’s rapidly implemented and scalable.

Synthetic Monitoring

In the DevOps world, synthetic monitoring is gaining a lot of traction.  With synthetic monitoring engineers run simulated user transactions against the application from external locations. Generally, the most simple synthetic test is just a ping test to see if the site is up. Engineers can run that from multiple locations, and run it every minute, to make sure that performance for users in Singapore is just as good as performance for users in Cincinnati, for example. The testing is done repeatedly from all the different locations around the globe where the users are. That's key to ensuring that features are working as expected for all your users, all the time.

The next most advanced step of synthetic monitoring is actually defining the key product flows.  Whether it's adding something to the cart, completing a checkout for an e-commerce site, or posting a comment on a blog thread, these all need to be tested.

Most synthetic monitoring tools can be used for things other than DevOps but we can't do DevOps without the synthetic monitoring tools. It's the way these tools are used in a collaborative environment that makes them outstanding to support DevOps

Synthetic monitoring is becoming more and more embedded in standard DevOps practices. There isn't a separate QA team. If there is, it's generally responsible for setting strategy, and guiding principles, and providing a framework under which each of those agile teams operate. 

Synthetic monitoring is low-hanging fruit for monitoring and automation, which is core to DevOps.  Customers can't have a site be down and not know about it. Synthetic monitoring tells us that even though it only tells you when there is a problem.  It can’t predict problems. Nevertheless, if you're not implementing synthetic monitoring and basic user journeys on your key properties, from your key locations, you missed something fundamental.  That's a key first step.

Machine Learning Is Supported

Machine-learning can also quickly ramp up efficiency. The tools can ingest all of the incident data, including ServiceNow logs.  Engineers can learn when the incident happened and can start to get the machine to learn to look for the same trends. Then managers can predict outages.

To reduce downtime tools are really important, but so is the culture around the tools.  In addition to choosing tools, managers need to discuss organizational structure, and talk about all the different moving parts related to application roll-outs.  They need to have a change communicator work with the organization, and then get the DevOps engineers to work with the teams, and maybe even off-shore some 24/7 work. Finally, managers should build a roadmap to look at what can be more automated and where managers can apply machine learning.

Try FlexNet Code Aware Today! A free scan tool for developers. Scan Java, NuGet, and NPM packages for open source security and license compliance issues.

Topics:
open source monitoring ,open source tools ,synthetic monitoring ,open source ,machine learning ,data silos

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}