Data Engineering Resources

Decoding Large Language Models and How They Work

The article reviews how Large Language and Multimodal Models process text and images using tokenization, embeddings, and architectures like CNNs and ViTs.

February 20, 2024

by Smit Dagli

· 6,830 Views · 2 Likes

How To Integrate NCache With JPA Hibernate for Caching in Spring Boot Applications

In this article, let’s discuss the caching feature of Hibernate with NCache for caching in a Spring Boot application with an illustrating example.

February 20, 2024

by Sriram Kumar Mannava

· 5,789 Views · 2 Likes

Data Mesh: A Paradigm Shift in Data Management

Data mesh is a new technology that could provide a framework for managing distributed data ecosystems more effectively by treating data as a product.

February 20, 2024

by Suresh Martha

· 2,983 Views · 2 Likes

AI and Microservice Architecture, A Perfect Match?

AI and Microservices blend, revolutionizing software with scalable, flexible, and efficient solutions, navigating through complexity and security hurdles.

February 20, 2024

by Dileep Kumar Pandiya

· 6,316 Views · 1 Like

Disaster Recovery and High Availability Solutions in SQL Server

Learn about always-on availability groups, database mirroring, log shipping, and replication as methods of disaster recovery and high availability.

February 20, 2024

by Smit Dagli

· 4,014 Views · 1 Like

Exploring Parallel Processing: SIMD vs. MIMD Architectures

We will discuss SIMD and MIMD architectures and how they play vital roles in enhancing computational efficiency and facilitating parallel processing tasks.

February 20, 2024

by Aditya Bhuyan

· 3,936 Views · 2 Likes

A Deep Dive Into Data Orchestration With Airbyte, Airflow, Dagster, and Prefect

This article delves into the integration of Airbyte with some of the most popular data orchestrators in the industry – Apache Airflow, Dagster, and Prefect.

February 20, 2024

by John Lafleur

· 3,580 Views · 2 Likes

Distributed Task Synchronization: Leveraging ShedLock in Spring

In this article, learn how to execute tasks in distributed systems using ShedLock, a useful tool for coordinating tasks in complex Spring applications.

February 19, 2024

by Viacheslav Shago

· 9,659 Views · 5 Likes

Spring Boot 3.2: Replace Your RestTemplate With RestClient

This Spring Boot 3.2 tutorial explores an addition built upon WebClient called RestClient, a more intuitive and modern approach to consuming RESTful services.

February 19, 2024

by Fernando Boaglio

· 69,851 Views · 11 Likes

Building and Integrating REST APIs With AWS RDS Databases: A Node.js Example

This guide walks through the process of creating a RESTful API that talks to an Amazon Relational Database Service (RDS) instance, complete with examples.

February 19, 2024

by Vijay Panwar

CORE

· 8,858 Views · 2 Likes

Python Function Pipelines: Streamlining Data Processing

Function pipelines allow seamless execution of multiple functions in a sequential manner, where the output of one function serves as the input to the next.

February 19, 2024

by Sameer Shukla

CORE

· 9,187 Views · 8 Likes

Recover Distributed Transactions in MySQL

How to identify and troubleshoot distributed (XA) transactions stuck in the prepared state in MySQL using XA recover, XA commit, and XA rollback commands.

February 19, 2024

by Tasos Papadopoulos

· 4,840 Views · 1 Like

How To Deploy Machine Learning Models Using Amazon SageMaker

Learn how to deploy machine learning models efficiently using Amazon SageMaker. Discover step-by-step instructions, advantages, and expert assistance from Softweb.

February 19, 2024

by Chiragsinh Vaghela

· 2,331 Views · 2 Likes

Top 5 Trends for Data Streaming With Kafka and Flink in 2024

Top 5 Trends for Data Streaming with Apache Kafka and Flink: data sharing, data contracts, multi-cloud, serverless stream processing, GenAI.

February 19, 2024

by Kai Wähner

CORE

· 4,678 Views · 2 Likes

Prompt Engineering Tutorial for AI/ML Engineers

What is prompt engineering and how does it work? In this article, we take a deep dive into prompt engineering, its techniques, and the best practices to be followed.

February 19, 2024

by Pavan Belagatti

CORE

· 5,892 Views · 2 Likes

NIST AI Risk Management Framework: Developer’s Handbook

The NIST AI Risk Management Framework offers a comprehensive approach to addressing the complex challenges associated with managing risks in AI technologies.

February 19, 2024

by Josephine Eskaline Joyce

CORE

· 6,134 Views · 11 Likes

Art of Code: Elegant Solutions in Software Development

In the grand tapestry of human creativity, the art of coding stands as a testament to the ingenuity and innovation of the human mind.

February 19, 2024

by Samir Hazra

· 3,078 Views · 2 Likes

Rethinking Domain Driven Design: Beyond Tactical Patterns

The mainstream thought on Domain Driven Design is focused on its tactical patterns. Unfortunately, all those discussions are a disservice to the software community.

February 19, 2024

by Alexsandro Souza

· 2,537 Views · 2 Likes