Monitoring and Observability Resources for Engineers

AWS Airflow vs Step Functions: The Data Engineering Orchestration Dilemma

When you're building data pipelines in AWS, choosing between Managed Airflow and Step Functions isn't just a technical decision — it's a strategic one.

November 27, 2025

by Janani Annur Thiruvengadam

CORE

· 5,409 Views · 2 Likes

How to Push Docker Images to AWS Elastic Container Repository Using GitHub Actions

Learn how to automate CI/CD with GitHub Actions to build, tag, and push Docker images to AWS ECR, simplifying deployments directly from your repo.

November 26, 2025

by Purnima Upadhyaya

· 5,139 Views

Overview Of Observability As Code

Observability as Code allows teams to prioritize monitoring and telemetry within the software delivery lifecycle. It greatly enhances the reliability of your systems.

November 26, 2025

by sai saripalli

· 2,419 Views

Effective Strategies for AWS Cost Optimization

Proven tips and techniques for optimizing AWS costs, including monitoring usage, setting budgets, and leveraging cost-effective services

November 25, 2025

by Prabhakar Mishra

· 2,833 Views · 1 Like

Building a Containerized Quarkus API on AWS ECS/Fargate With CDK

Build production-ready Quarkus API on AWS ECS with CDK Infrastructure as Code. Includes database integration, caching, and comprehensive testing.

November 18, 2025

by Nicolas Duminil

CORE

· 5,151 Views

From Data Lakes to Intelligence Lakes: Augmenting Apache Iceberg With Generative AI Metadata on AWS

Build an AI-augmented data lake using Iceberg, Glue, and Bedrock to turn static metadata into searchable intelligence with semantic tags and AI summaries.

November 17, 2025

by Vivek Venkatesan

· 5,831 Views · 1 Like

Integrating AWS With Okta for Just-in-Time (JIT) Access: A Practical Guide From the Field

Static IAM users, login roles were killing our security posture and slowing everyone down. So we wired Okta and AWS with SAML and Okta Workflows for JIT access.

November 17, 2025

by Sanjay Kurra

· 4,924 Views · 3 Likes

Proactive vs Reactive: Rethinking Your AWS Monitoring Approach

Dynamic AWS environments require both reactive and proactive monitoring approaches for secure and reliable operations. Learn about their differences and best practices.

November 14, 2025

by Igboanugo David Ugochukwu

CORE

· 3,412 Views · 1 Like

The Terraform State Locking Migration You Need to Know About: Moving Beyond DynamoDB

What's happening: HashiCorp is deprecating DynamoDB-based state locking for Terraform's S3 backend. Native S3 locking is the new standard.

November 12, 2025

by kazeem mohammed

· 4,219 Views · 2 Likes

GitLab CI/CD for Tenant-Specific ML Governance: Automating Model Registries in Databricks Unity Catalog on AWS

Automate multi-tenant ML governance in Databricks with GitLab CI/CD, ensuring secure, compliant model registration, validation, and deployment.

November 12, 2025

by Ankur Mahida

· 16,643 Views · 4 Likes

How Tool-Call Observability Enables You to Support Reliable and Secure AI Agents

Observability is key for performance and data security. Here's how to build the essential components into your AI agent infrastructure

November 10, 2025

by Gil Feig

· 2,292 Views · 2 Likes

A Practical Guide to Modernizing Data Serving Architectures Using DBSQL

Learn how we replaced our traditional RDS serving layer with direct lakehouse querying to improve performance, reduce cost, and achieve real-time data freshness.

November 6, 2025

by PRAVEEN DOOTAGANI

· 3,074 Views

From Noise to Outcome-Driven Observability: An SLO-First Strategy to Deliver Business Value Through Telemetry

Learn how an SLO-first strategy transforms observability from reactive monitoring to proactive, outcome-driven reliability using OpenTelemetry and unified data practices.

November 4, 2025

by Stelios Manioudakis

CORE

· 13,943 Views · 1 Like

Building a Resilient Observability Stack in 2025: Practical Steps to Reduce Tool Sprawl With OpenTelemetry, Unified Platforms, and AI-Ready Monitoring

Learn how to cut observability tool sprawl, adopt OpenTelemetry, and build a vendor-neutral, AI-ready observability stack for reliability at scale in 2025.

November 3, 2025

by Marija Naumovska

CORE

· 3,344 Views · 1 Like

What Is Agent Observability? Key Lessons Learned

A foundational guide to the key concepts of agent observability including best practices, metrics, and common challenges.

November 3, 2025

by Lior Gavish

· 2,809 Views · 3 Likes

A Framework for Securing Open-Source Observability at the Edge

Build secure observability solutions for distributed edge environments using open-source telemetry. Achieve zero security incidents and full compliance.

October 31, 2025

by Prakash Velusamy

· 3,918 Views · 1 Like

Unlocking Scalable Data Lakes: Building With Apache Iceberg, AWS Glue, and S3

Apache Iceberg + AWS Glue + S3 bring ACID, schema evolution, and time travel to data lakes—fixing schema drift, small files, and cost sprawl at enterprise scale.

October 28, 2025

by Vivek Venkatesan

· 3,944 Views · 1 Like

Understand and Optimize AWS Aurora Global Database

The default settings in AWS Aurora Global may not work for everyone. This article explains various settings and their implications in availability and consistency.

October 28, 2025

by Subhash Kovela

· 2,067 Views · 1 Like

Mastering Fluent Bit: Top Tips Using Telemetry Pipeline Parsers for Developers (Part 8)

This intro to mastering Fluent Bit covers handy tips and tricks for speeding up the inner development loop using parsers in telemetry pipelines.

October 27, 2025

by Eric D. Schabell

CORE

· 1,598 Views · 2 Likes

Enterprise-Grade Document Intelligence: Cloud Big Data AI With YOLOv9 and Spark on AWS

Automate document analysis with YOLOv9, Apache Spark, and AWS. Boost speed, accuracy, and fraud detection across finance, healthcare, insurance, and more.

October 27, 2025

by Ram Ghadiyaram

CORE

· 2,621 Views · 4 Likes

The Latest Monitoring and Observability Topics