Data Engineering Resources

Resolving Parameter Sensitivity With Parameter Sensitive Plan Optimization in SQL Server 2022

Learn how SQL Server 2022's Parameter Sensitive Plan Optimization (PSP) solves parameter sniffing by caching multiple execution plans for parameterized queries.

May 30, 2025

by arvind toorpu

CORE

· 3,827 Views · 3 Likes

Source-Driven Development in Salesforce: Managing Metadata and API Versions

Source-Driven Development streamlines Salesforce deployments with version control and consistent API management, boosting stability and scalability.

May 30, 2025

by Ilya Dudkin

CORE

· 3,846 Views · 1 Like

Designing Fault-Tolerant Messaging Workflows Using State Machine Architecture

State machine patterns, such as Stateful Workflows, Sagas, and Replicated State Machines, improve message reliability, sync consistency, and recovery.

May 30, 2025

by Pankaj Taneja

· 4,364 Views · 3 Likes

Apache Spark 4.0: Transforming Big Data Analytics to the Next Level

Apache Spark 4.0 brings PySpark plotting, polymorphic UDTFs, improved SQL scripting, and Python API updates to enhance real-time analytics and usability.

May 30, 2025

by Ram Ghadiyaram

CORE

· 5,656 Views · 6 Likes

Bridging UI, DevOps, and AI: A Full-Stack Engineer’s Approach to Resilient Systems

Build resilient full-stack systems with Angular, Node.js, DevOps, and AI — featuring CI/CD, microservices, error handling, and future-ready UI with edge AI.

May 29, 2025

by Bhanu Sekhar Guttikonda

CORE

· 4,104 Views · 4 Likes

ACID vs BASE: Transaction Models Explained

When it comes to handling transactions, its ACID vs BASE principles. I will cover their description, use cases, and in-depth comparison.

May 29, 2025

by Bartłomiej Żyliński

CORE

· 2,842 Views

Hyperparameter Tuning: An Overview and a Real-World Example

Hyperparameter tuning is critical to optimizing machine learning models, significantly enhancing their performance. This article provides an accessible guide to tuning.

May 29, 2025

by Shailendra Prajapati

· 2,521 Views

Introducing Graph Concepts in Java With Eclipse JNoSQL, Part 2: Understanding Neo4j

Learn how to integrate Neo4j into Java apps using Eclipse JNoSQL 1.1.8 — model entities, define relationships, and query graphs with Cypher and Jakarta Data.

May 28, 2025

by Otavio Santana

CORE

· 4,905 Views · 1 Like

Is Big Data Dying?

Explore the evolution of big data, from Hadoop to cloud-native platforms like Snowflake, and learn how specialized skills shape this thriving industry's future.

May 28, 2025

by bingxi Wu

· 3,692 Views · 1 Like

Comparing Managed Postgres Options on The Azure Marketplace

Azure offers several managed Postgres services designed for a variety of use cases. In this article, we review the key differences among them.

May 28, 2025

by Carlota Soto

· 4,526 Views · 2 Likes

How to Use AWS Aurora Database for a Retail Point of Sale (POS) Transaction System

Using Aurora, AWS's managed, highly scalable relational database, for a POS transaction system ensures efficient scaling to handle high transaction volumes.

May 28, 2025

by Spurthi Jambula

· 4,310 Views · 2 Likes

AI Agents: A New Era for Integration Professionals

Are AI agents just an integration flow with a few extra tricks? Learn what AI agents are and how and where they add value in the current AI landscape.

May 28, 2025

by Gnanaguru Sattanathan

· 3,755 Views · 2 Likes

ITBench, Part 1: Next-Gen Benchmarking for IT Automation Evaluation

Learn more about ITBench, an open framework to benchmark AI agents for IT automation, focusing on reliability, efficiency, and real-world IT scenarios.

May 28, 2025

by Anca Sailer

· 3,830 Views · 1 Like

Memory-Optimized Tables: Implementation Strategies for SQL Server

Through practical implementation guidance and real-world examples, learn how this in-memory technology can deliver 5- 30x performance improvements for OLTP workloads.

May 28, 2025

by arvind toorpu

CORE

· 4,634 Views · 4 Likes

Beyond Accuracy: A Product-Led Case for State Space Models Over Transformers

Transformers dominate AI but struggle with long texts. State Space Models (SSMs) are faster and more efficient for production.

May 28, 2025

by Albert Lie

· 1,663 Views

How to Introduce a New API Quickly Using Micronaut

Knowing when to pivot can be vital to staying ahead of the competition. See how Cursor AI and Heroku can be leveraged to transform an idea into a reality.

May 28, 2025

by John Vester

CORE

· 14,090 Views · 2 Likes

Useful System Table Queries in Relational Databases

System tables store metadata about database objects like tables, columns, indexes, users, and privileges, which helps in understanding the configuration.

May 27, 2025

by Dhaval Patolia

· 3,184 Views · 2 Likes

How To Build AI-Powered Prompt Templates Using the Salesforce Prompt Builder

We know the power of Generative AI and how to write prompts, but Salesforce also provides a tool to create effective prompts using Prompt Builder.

May 27, 2025

by Srinivas Sandiri

· 2,811 Views

Optimizing Serverless Computing with AWS Lambda Layers and CloudFormation

Learn how AWS Lambda Layers and CloudFormation simplify serverless computing by managing dependencies and automating infrastructure provisioning.

May 27, 2025

by Srinivas Chippagiri

CORE

· 17,336 Views · 3 Likes

A Guide to Auto-Tagging and Lineage Tracking With OpenMetadata

Learn how to automate PII tagging, metadata management, and SQL lineage tracking with GPT-4, OpenMetadata, dbt, Trino, and Python for smarter data governance.

May 27, 2025

by Sreenath Devineni

CORE

· 6,053 Views

The Latest Data Engineering Topics