Death to APM and Logging Silos
Death to APM and Logging Silos
One of the biggest detriments to performance and logging is silos. While these might bring life to animals on the farm, silos can help your APM and logging strategies buy the farm.
Join the DZone community and get the full member experience.Join For Free
Sensu is an open source monitoring event pipeline. Try it today.
Sematext has combined the power of SPM and Logsene in a single pane of glass – a unified view into all the key bits of operational intelligence every DevOps engineer needs: server and application performance metrics, logs, events, anomalies, alerts, ChatOps integrations, etc. In other words, the whole is greater than the sum of its parts.
Metrics + Logs Correlation Using SPM and Logsene Together in One UI
This video demonstrates how the SPM + Logsene combination solves the problems of having too much data to manage yourself and the disconnect when metrics and logs are siloed. We address two of the most common problems — and their solutions — below the video.
Problem 1 – Big Data, Big Burden: Servers, containers, apps, and devices spew out more and more data: more metrics, more logs, more events. Collecting and storing all this data is a challenge and is often not cheap both in terms of time invested in building large-scale data collection, storage, and retrieval systems, maintaining them, as well as providing the adequate infrastructure to run them.
Solution: Focus on your organization’s core business, your core strength, and outsource needlessly painful or expensive parts to those who specialize in them. We already outsource all the time, except we don’t call it “outsourcing”: we buy food, we don’t grow or raise it. We buy cars and don’t build them. Most of us don’t buy physical servers any more. Why? Because others do that better, faster, cheaper.
Problem 2 – Metrics vs. Log Silos: Collecting and visualizing performance metrics and getting alerts when things go awry is great, but performance charts can tell us only so much. Code instrumentation, like SPM’s Transaction Tracing, goes deeper and provides more insight, but still doesn’t tell us the whole story. Similarly, collecting logs and being able to search them is very valuable. Unfortunately, oftentimes APM and log management solutions live in separate silos that don’t really talk to each other.
Solution: Don’t waste your time jumping between multiple disconnected solutions, be they open-source or commercial. Time is the most precious thing each of us has, and our time as DevOps engineers is very expensive. Use a tool or service that gives you access to as many bits of operational information that you need as possible. Not only is this more efficient, and thus cheaper, it’s also much more pleasant than jumping between solutions for browser and terminal, top, vmstat, dstat, less, grep, etc. which are needlessly manual and get boring.
Troubleshooting Doesn’t Need to Take Over Your Life
Troubleshooting production performance issues, dealing with APM alerts and even looking at logs (don’t even think about grepping!) isn’t that hard or time consuming. Well, as long as you have the right tools, that is.
Cloud and On Premises Deployments
Unlike most monitoring and logging solutions, Sematext offers both Cloud and On Premises deployments for SPM and Logsene. We’re happy to discuss package pricing if you’d like to combine both products.
Published at DZone with permission of Mick Emmett , DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.