Data Engineering Resources

AWS vs. Azure: Which Is Better for Cloud Computing?

In this article, discover the key features that can help you settle the AWS vs. Azure debate when picking a cloud provider.

February 20, 2024

by Anthony Neto

· 2,650 Views · 2 Likes

MLOps vs. DevOps: The Key Similarities and Differences

DevOps integrates software applications, and MLOps implements quality checks and tests for data pipelines and machine learning model training and deployment.

February 20, 2024

by Florian Pialoux

· 2,047 Views · 1 Like

Decoding Large Language Models and How They Work

The article reviews how Large Language and Multimodal Models process text and images using tokenization, embeddings, and architectures like CNNs and ViTs.

February 20, 2024

by Smit Dagli

· 3,381 Views · 1 Like

How To Integrate NCache With JPA Hibernate for Caching in Spring Boot Applications

In this article, let’s discuss the caching feature of Hibernate with NCache for caching in a Spring Boot application with an illustrating example.

February 20, 2024

by Sriram Kumar Mannava

· 5,000 Views · 2 Likes

Data Mesh: A Paradigm Shift in Data Management

Data mesh is a new technology that could provide a framework for managing distributed data ecosystems more effectively by treating data as a product.

February 20, 2024

by Suresh Martha

· 2,259 Views · 2 Likes

AI and Microservice Architecture, A Perfect Match?

AI and Microservices blend, revolutionizing software with scalable, flexible, and efficient solutions, navigating through complexity and security hurdles.

February 20, 2024

by Dileep Kumar Pandiya

· 4,367 Views · 1 Like

Disaster Recovery and High Availability Solutions in SQL Server

Learn about always-on availability groups, database mirroring, log shipping, and replication as methods of disaster recovery and high availability.

February 20, 2024

by Smit Dagli

· 2,711 Views · 1 Like

Exploring Parallel Processing: SIMD vs. MIMD Architectures

We will discuss SIMD and MIMD architectures and how they play vital roles in enhancing computational efficiency and facilitating parallel processing tasks.

February 20, 2024

by Aditya Bhuyan

· 3,404 Views · 2 Likes

A Deep Dive Into Data Orchestration With Airbyte, Airflow, Dagster, and Prefect

This article delves into the integration of Airbyte with some of the most popular data orchestrators in the industry – Apache Airflow, Dagster, and Prefect.

February 20, 2024

by John Lafleur

· 2,965 Views · 2 Likes

Distributed Task Synchronization: Leveraging ShedLock in Spring

In this article, learn how to execute tasks in distributed systems using ShedLock, a useful tool for coordinating tasks in complex Spring applications.

February 19, 2024

by Viacheslav Shago

· 4,358 Views · 5 Likes

Spring Boot 3.2: Replace Your RestTemplate With RestClient

This Spring Boot 3.2 tutorial explores an addition built upon WebClient called RestClient, a more intuitive and modern approach to consuming RESTful services.

February 19, 2024

by Fernando Boaglio

· 39,705 Views · 11 Likes

Building and Integrating REST APIs With AWS RDS Databases: A Node.js Example

This guide walks through the process of creating a RESTful API that talks to an Amazon Relational Database Service (RDS) instance, complete with examples.

February 19, 2024

by Vijay Panwar

CORE

· 7,070 Views · 2 Likes

Python Function Pipelines: Streamlining Data Processing

Function pipelines allow seamless execution of multiple functions in a sequential manner, where the output of one function serves as the input to the next.

February 19, 2024

by Sameer Shukla

CORE

· 6,251 Views · 8 Likes

Recover Distributed Transactions in MySQL

How to identify and troubleshoot distributed (XA) transactions stuck in the prepared state in MySQL using XA recover, XA commit, and XA rollback commands.

February 19, 2024

by Tasos Papadopoulos

· 3,152 Views · 1 Like

How To Deploy Machine Learning Models Using Amazon SageMaker

Learn how to deploy machine learning models efficiently using Amazon SageMaker. Discover step-by-step instructions, advantages, and expert assistance from Softweb.

February 19, 2024

by Chiragsinh Vaghela

· 1,805 Views · 2 Likes

Top 5 Trends for Data Streaming With Kafka and Flink in 2024

Top 5 Trends for Data Streaming with Apache Kafka and Flink: data sharing, data contracts, multi-cloud, serverless stream processing, GenAI.

February 19, 2024

by Kai Wähner

CORE

· 4,159 Views · 2 Likes

Prompt Engineering Tutorial for AI/ML Engineers

What is prompt engineering and how does it work? In this article, we take a deep dive into prompt engineering, its techniques, and the best practices to be followed.

February 19, 2024

by Pavan Belagatti

CORE

· 4,179 Views · 1 Like

NIST AI Risk Management Framework: Developer’s Handbook

The NIST AI Risk Management Framework offers a comprehensive approach to addressing the complex challenges associated with managing risks in AI technologies.

February 19, 2024

by Josephine Eskaline Joyce

CORE

· 4,582 Views · 11 Likes

Art of Code: Elegant Solutions in Software Development

In the grand tapestry of human creativity, the art of coding stands as a testament to the ingenuity and innovation of the human mind.

February 19, 2024

by Samir Hazra

· 2,214 Views · 2 Likes

Rethinking Domain Driven Design: Beyond Tactical Patterns

The mainstream thought on Domain Driven Design is focused on its tactical patterns. Unfortunately, all those discussions are a disservice to the software community.

February 19, 2024

by Alexsandro Souza

· 1,955 Views · 1 Like

The Latest Data Engineering Topics