Data Engineering Resources

How to Configure and Customize the Go SDK for Azure Cosmos DB

Explore Azure Cosmos DB Go SDK: Configure retry policies, customize HTTP pipelines, implement OpenTelemetry tracing, and analyze detailed query metrics.

May 8, 2025

by Abhishek Gupta

CORE

· 4,937 Views · 1 Like

Scalable System Design: Core Concepts for Building Reliable Software

Learn the essentials of software system design—covering scalability, performance, and maintainability for building robust, large-scale systems.

May 8, 2025

by Mahesh Ganesamoorthi

· 3,514 Views

Start Coding With Google Cloud Workstations

Boost your development productivity with secure, GPU-powered Cloud Workstations. This guide shows you how to set up your environment and connect to BigQuery.

May 8, 2025

by Karteek Kotamsetty

· 37,511 Views · 3 Likes

Getting Started With GenAI on BigQuery: A Step-by-Step Guide

This article shows how to use Google Cloud's BigQuery ML and Gemini to analyze and summarize text data directly within BigQuery using SQL and ML.GENERATE_TEXT function.

May 8, 2025

by Nivedita Kumari

· 3,792 Views

Artificial Intelligence, Real Consequences: Balancing Good vs Evil AI [Infographic]

Is AI bringing about positive change? What are the long-term repercussions? Let's explore the exciting yet intensifying pressure of AI.

May 8, 2025

by DZone Editorial

· 4,202 Views · 5 Likes

Building Enterprise-Ready Landing Zones: Beyond the Initial Setup

A successful landing zone requires a carefully customized foundation that addresses organizational needs rather than relying on default cloud provider templates.

May 7, 2025

by Gaurav Mittal

· 4,444 Views · 2 Likes

Event-Driven Architectures: Designing Scalable and Resilient Cloud Solutions

Learn how to enhance scalability, resilience, and efficiency in cloud solutions using event-driven architectures with this step-by-step guide.

May 7, 2025

by Srinivas Chippagiri

CORE

· 20,940 Views · 4 Likes

Measuring the Impact of AI on Software Engineering Productivity

AI-assisted coding tools promise large productivity gains. But does AI generated code really equate to higher engineering productivity? We dive into the details.

May 7, 2025

by Ralf Huuck

· 2,607 Views · 1 Like

Transforming AI-Driven Data Analytics with DeepSeek: A New Era of Intelligent Insights

AI-driven analytics is revolutionizing data processing, enhancing automation, optimizing decision-making, and tackling challenges like scalability, latency, and security.

May 7, 2025

by Shafeeq Ur Rahaman

· 2,949 Views

Medallion Architecture: Why You Need It and How To Implement It With ClickHouse

Discover how the medallion architecture streamlines data pipelines and enhances real-time analytics at scale using ClickHouse.

May 7, 2025

by Syed Siraj Mehmood

· 4,664 Views · 2 Likes

Kubeflow: Driving Scalable and Intelligent Machine Learning Systems

Kubeflow streamlines and scales machine learning workflows on Kubernetes, improving deployment, interoperability, and efficiency.

May 7, 2025

by Anupama Babu

· 2,657 Views · 2 Likes

Unlocking the Potential of Apache Iceberg: A Comprehensive Analysis

Organization adoption perspective and key considerations of Apache Iceberg, a high-performance open-source format for large analytic tables.

May 6, 2025

by Ram Ghadiyaram

CORE

· 5,355 Views · 6 Likes

Beyond ChatGPT, AI Reasoning 2.0: Engineering AI Models With Human-Like Reasoning

Build a practical AI reasoning system from scratch using Python, focusing on real-world applications and step-by-step implementation.

May 6, 2025

by Mahesh Vaijainthymala Krishnamoorthy

· 2,524 Views · 1 Like

Hybrid Cloud vs Multi-Cloud: Choosing the Right Strategy for AI Scalability and Security

As AI adoption accelerates, enterprises must choose the right cloud strategy to ensure scalability, security, and performance.

May 6, 2025

by Vaibhav Tupe

· 5,239 Views

A Guide to Developing Large Language Models Part 1: Pretraining

In this article, we will cover key concepts in LLM pretraining, focusing on language model basics, data, scaling laws, and evaluation.

May 6, 2025

by Inderjot Singh Saggu

· 3,595 Views · 2 Likes

AI, ML, and Data Science: Shaping the Future of Automation

AI, machine learning, and data science are transforming industries, driving automation, advancing innovation, and addressing challenges like data privacy and bias.

May 6, 2025

by Shafeeq Ur Rahaman

· 3,579 Views

OpenSearch: Introduction and Data Management Patterns

A practical guide to OpenSearch for data and platform engineers—covering core concepts, usage patterns, and best practices for scalable search and analytics.

May 5, 2025

by Itamar Syn-hershko

· 2,505 Views

A Developer's Guide to Mastering Agentic AI: From Theory to Practice

The next evolution of AI: systems that autonomously plan, reason, and act to achieve complex goals. This guide offers a structured path for developers.

May 5, 2025

by Somanath Balakrishnan

CORE

· 4,925 Views · 6 Likes

Recurrent Workflows With Cloud Native Dapr Jobs

Workflow scheduling is something we see often. As part of this article, we will look at how Dapr Jobs helps to easily run periodic workloads.

May 5, 2025

by Siri Varma Vegiraju

CORE

· 25,868 Views · 1 Like

Unlocking the Benefits of a Private API in AWS API Gateway

Unlock new opportunities with Private APIs while staying vigilant against data exposure and unauthorized access. Learn how to secure your services effectively today.

May 5, 2025

by Satrajit Basu

CORE

· 6,382 Views · 3 Likes

The Latest Data Engineering Topics