Monitoring and Observability Resources for Engineers

From Data Lakes to Intelligence Lakes: Augmenting Apache Iceberg With Generative AI Metadata on AWS

Build an AI-augmented data lake using Iceberg, Glue, and Bedrock to turn static metadata into searchable intelligence with semantic tags and AI summaries.

November 17, 2025

by Vivek Venkatesan

· 5,955 Views · 1 Like

Integrating AWS With Okta for Just-in-Time (JIT) Access: A Practical Guide From the Field

Static IAM users, login roles were killing our security posture and slowing everyone down. So we wired Okta and AWS with SAML and Okta Workflows for JIT access.

November 17, 2025

by Sanjay Kurra

· 5,263 Views · 3 Likes

Proactive vs Reactive: Rethinking Your AWS Monitoring Approach

Dynamic AWS environments require both reactive and proactive monitoring approaches for secure and reliable operations. Learn about their differences and best practices.

November 14, 2025

by Igboanugo David Ugochukwu

CORE

· 3,536 Views · 1 Like

The Terraform State Locking Migration You Need to Know About: Moving Beyond DynamoDB

What's happening: HashiCorp is deprecating DynamoDB-based state locking for Terraform's S3 backend. Native S3 locking is the new standard.

November 12, 2025

by kazeem mohammed

· 4,458 Views · 2 Likes

GitLab CI/CD for Tenant-Specific ML Governance: Automating Model Registries in Databricks Unity Catalog on AWS

Automate multi-tenant ML governance in Databricks with GitLab CI/CD, ensuring secure, compliant model registration, validation, and deployment.

November 12, 2025

by Ankur Mahida

· 16,802 Views · 4 Likes

How Tool-Call Observability Enables You to Support Reliable and Secure AI Agents

Observability is key for performance and data security. Here's how to build the essential components into your AI agent infrastructure

November 10, 2025

by Gil Feig

· 2,431 Views · 2 Likes

A Practical Guide to Modernizing Data Serving Architectures Using DBSQL

Learn how we replaced our traditional RDS serving layer with direct lakehouse querying to improve performance, reduce cost, and achieve real-time data freshness.

November 6, 2025

by PRAVEEN DOOTAGANI

· 3,189 Views

From Noise to Outcome-Driven Observability: An SLO-First Strategy to Deliver Business Value Through Telemetry

Learn how an SLO-first strategy transforms observability from reactive monitoring to proactive, outcome-driven reliability using OpenTelemetry and unified data practices.

November 4, 2025

by Stelios Manioudakis

CORE

· 14,157 Views · 1 Like

Building a Resilient Observability Stack in 2025: Practical Steps to Reduce Tool Sprawl With OpenTelemetry, Unified Platforms, and AI-Ready Monitoring

Learn how to cut observability tool sprawl, adopt OpenTelemetry, and build a vendor-neutral, AI-ready observability stack for reliability at scale in 2025.

November 3, 2025

by Marija Naumovska

CORE

· 3,588 Views · 1 Like

What Is Agent Observability? Key Lessons Learned

A foundational guide to the key concepts of agent observability including best practices, metrics, and common challenges.

November 3, 2025

by Lior Gavish

· 2,932 Views · 3 Likes

A Framework for Securing Open-Source Observability at the Edge

Build secure observability solutions for distributed edge environments using open-source telemetry. Achieve zero security incidents and full compliance.

October 31, 2025

by Prakash Velusamy

· 4,182 Views · 1 Like

Unlocking Scalable Data Lakes: Building With Apache Iceberg, AWS Glue, and S3

Apache Iceberg + AWS Glue + S3 bring ACID, schema evolution, and time travel to data lakes—fixing schema drift, small files, and cost sprawl at enterprise scale.

October 28, 2025

by Vivek Venkatesan

· 4,084 Views · 1 Like

Understand and Optimize AWS Aurora Global Database

The default settings in AWS Aurora Global may not work for everyone. This article explains various settings and their implications in availability and consistency.

October 28, 2025

by Subhash Kovela

· 2,137 Views · 1 Like

Mastering Fluent Bit: Top Tips Using Telemetry Pipeline Parsers for Developers (Part 8)

This intro to mastering Fluent Bit covers handy tips and tricks for speeding up the inner development loop using parsers in telemetry pipelines.

October 27, 2025

by Eric D. Schabell

CORE

· 1,681 Views · 2 Likes

Enterprise-Grade Document Intelligence: Cloud Big Data AI With YOLOv9 and Spark on AWS

Automate document analysis with YOLOv9, Apache Spark, and AWS. Boost speed, accuracy, and fraud detection across finance, healthcare, insurance, and more.

October 27, 2025

by Ram Ghadiyaram

CORE

· 2,747 Views · 4 Likes

From Distributed Monolith to Composable Architecture on AWS

Learn in this article how to fix distributed monoliths with Domain-Driven Composable Architecture and build independent, composable microservices on AWS.

October 24, 2025

by Elakkiya Daivam

· 8,965 Views · 1 Like

Evolving Golden Paths: Upgrades Without Disruption

Keep your golden paths evolving — with semantic versioning, automation, and empathy — to drive innovation without breaking developer flow.

October 23, 2025

by Josephine Eskaline Joyce, Ph.D

CORE

· 14,764 Views · 3 Likes

Automating Storage Tiering and Lifecycle Policies in AWS S3 Using Python (Boto3)

You can save money on AWS S3 by using Python scripts to automatically move files between storage classes based on how often you access them.

October 21, 2025

by Arjun Mullick

· 2,911 Views · 1 Like

Should You Use Azure Data Factory?

Yes for most ETL scenarios, ADF handles data movement, basic transformations, and scheduling well, just don't expect it to replace custom code for complex business logic.

October 20, 2025

by Sohag Maitra

· 6,769 Views

Beyond Keywords: Modernizing Enterprise Search with Vector Databases

A modern search approach unlocks deeper insights, more relevant results, and boosts productivity across organizations; here's how AWS OpenSearch fits into this landscape.

October 17, 2025

by Lakshmi Narayana Rasalay

· 4,556 Views · 1 Like

The Latest Monitoring and Observability Topics