Data Engineering Resources

A Guide to Developing Large Language Models Part 1: Pretraining

In this article, we will cover key concepts in LLM pretraining, focusing on language model basics, data, scaling laws, and evaluation.

May 6, 2025

by Inderjot Singh Saggu

· 3,463 Views · 2 Likes

AI, ML, and Data Science: Shaping the Future of Automation

AI, machine learning, and data science are transforming industries, driving automation, advancing innovation, and addressing challenges like data privacy and bias.

May 6, 2025

by Shafeeq Ur Rahaman

· 3,496 Views

OpenSearch: Introduction and Data Management Patterns

A practical guide to OpenSearch for data and platform engineers—covering core concepts, usage patterns, and best practices for scalable search and analytics.

May 5, 2025

by Itamar Syn-hershko

· 2,298 Views

A Developer's Guide to Mastering Agentic AI: From Theory to Practice

The next evolution of AI: systems that autonomously plan, reason, and act to achieve complex goals. This guide offers a structured path for developers.

May 5, 2025

by Somanath Balakrishnan

CORE

· 4,779 Views · 6 Likes

Recurrent Workflows With Cloud Native Dapr Jobs

Workflow scheduling is something we see often. As part of this article, we will look at how Dapr Jobs helps to easily run periodic workloads.

May 5, 2025

by Siri Varma Vegiraju

CORE

· 25,779 Views · 1 Like

Unlocking the Benefits of a Private API in AWS API Gateway

Unlock new opportunities with Private APIs while staying vigilant against data exposure and unauthorized access. Learn how to secure your services effectively today.

May 5, 2025

by Satrajit Basu

CORE

· 6,280 Views · 3 Likes

AI Meets Vector Databases: Redefining Data Retrieval in the Age of Intelligence

Learn how AI and vector databases enable searches by meaning, powering smarter recommendations, chatbots, and tools for handling unstructured data.

May 5, 2025

by Anand Singh

· 2,444 Views · 1 Like

APIs for Logistics Orchestration: Designing for Compliance, Exceptions, and Edge Cases

Logistics APIs aren’t just code, they’re legal, chaotic, exception-wrangling superheroes holding global trade together with duct tape and schema.

May 5, 2025

by Srikrishna Jayaram

· 2,832 Views

From Fragmentation to Focus: A Data-First, Team-First Framework for Platform-Driven Organizations

Learn how to elevate data to a first-class citizen through a Data-First, Team-First approach and empower teams to innovate with autonomy.

May 2, 2025

by Paul Gale

· 2,757 Views

Microsoft Azure Synapse Analytics: Scaling Hurdles and Limitations

Azure Synapse faces serious challenges limiting its use in the Enterprise Data space, impacting performance and functionality.

May 2, 2025

by Vamshidhar Morusu

· 4,890 Views · 2 Likes

AI-Assisted Coding for iOS Development: How Tools like CursorAI Are Redefining the Developer Workflow

AI Assisted coding is changing iOS development fundamentally. Tools like CursorAI are helping iOS developers ship apps faster.

May 2, 2025

by Prithiv Dev Devendran

· 2,668 Views

Unlocking AI Coding Assistants Part 4: Generate Spring Boot Application

Determine whether it's feasible to build a production-grade Spring Boot application from scratch using a large language model (LLM) as an AI coding assistant.

May 2, 2025

by Gunter Rotsaert

CORE

· 4,319 Views · 3 Likes

Comparing SaaS vs. PaaS for Kafka and Flink Data Streaming

SaaS vs. PaaS Data Streaming: Understand key differences in Apache Kafka and Flink cloud deployments to balance control, cost and ease of use.

May 2, 2025

by Kai Wähner

CORE

· 3,946 Views · 1 Like

My LLM Journey as a Software Engineer Exploring a New Domain

Here is rant about a software engineer putting on a non-developer hat by leveraging AI to attempt to conquer an unfamiliar territory.

May 1, 2025

by Dale Waterworth

· 3,080 Views · 1 Like

Evolution of Cloud Services for MCP/A2A Protocols in AI Agents

The adoption of MCP and A2A protocols is reshaping cloud service architectures by enabling the development of modular, interoperable, and scalable AI systems.

May 1, 2025

by Bhala Ranganathan

CORE

· 4,831 Views · 4 Likes

Zero Trust for AWS NLBs: Why It Matters and How to Do It

Implementing Zero Trust with NLB helps create robust security for your network while preserving the performance benefits of network load balancing (NLB).

May 1, 2025

by Sathish Holla

· 5,735 Views · 4 Likes

GDPR compliance doesn’t have to slow down your app. ASP.NET Core helps you build secure and high-performing applications that meet regulatory standards.

May 1, 2025

by Humna Ghufran

· 4,841 Views · 2 Likes

The 4 R’s of Pipeline Reliability: Designing Data Systems That Last

In this article, learn how the 4 R’s — robust architecture, resumability, recoverability, and redundancy — enhance reliability in AI and ML data pipelines.

May 1, 2025

by Sidhant bendre

· 5,177 Views · 2 Likes