DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
  1. DZone
  2. Data Engineering
  3. Data
  4. Log Analytics for Distributed Microservices

Log Analytics for Distributed Microservices

Take a look at Kai Wahner's presentation from OReillySACon in London, where he dives into how to handle log analytics for your scattered, distributed microservices.

Kai Wähner user avatar by
Kai Wähner
CORE ·
Oct. 24, 16 · Presentation
Like (3)
Save
Tweet
Share
3.91K Views

Join the DZone community and get the full member experience.

Join For Free

I had two sessions at O'Reilly Software Architecture Conference in London in October 2016. It was the first OReillySACon in London, and it was a well-organized conference with plenty of great speakers and sessions. I can really recommend this conference and its siblings in other cities, such as San Francisco or New York, if you want to learn about good software architectures and new concepts, best practices, and technologies. Some of the hot topics this year, besides microservices, were DevOps, serverless architectures, and big data analytics.

I want to share the slides of my session about comparing open source frameworks, SaaS, and Enterprise products regarding log analytics for distributed microservices.

Monitoring Distributed Microservices With Log Analytics

IT systems and applications generate more and more distributed machine data due to the millions of mobile devices, Internet of Things, social network users, and other new emerging technologies out there. However, organizations experience challenges when monitoring and managing their IT systems and technology infrastructure. They struggle with distributed Microservices and Cloud architectures, custom application monitoring and debugging, network and server monitoring/troubleshooting, security analysis, compliance standards, and others.

This session discusses how to solve the challenges of monitoring and analyzing terabytes and more of different distributed machine data to leverage the “digital business.” The main part of the session compares different open source frameworks and SaaS cloud solutions for Log Management and operational intelligence, such as Graylog , the “ELK stack”, Papertrail, Splunk, or TIBCO LogLogic). A live demo will demonstrate how to monitor and analyze distributed Microservices and sensor data from the “Internet of Things”

The session also explains the distinction of the discussed solutions to other big data components such as Apache Hadoop, Data Warehouse, or Machine Learning and its application to real-time processing, and how they can complement each other in a big data architecture.

The session concludes with an outlook to the new, advanced concept of IT Operations Analytics (ITOA).

Slide Deck from O'Reilly Software Architecture Conference


Related Articles: Four Tips for Logging Microservices, Microservices in Practice: From Architecture to Deployment, and Tools and Techniques for Logging Microservices

microservice Analytics Big data Software architecture Open source

Published at DZone with permission of Kai Wähner, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • AWS Cloud Migration: Best Practices and Pitfalls to Avoid
  • The Role of Data Governance in Data Strategy: Part II
  • How To Use Terraform to Provision an AWS EC2 Instance
  • Using JSON Web Encryption (JWE)

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: