Data Engineering Resources

The AI Revolution: Transforming the Software Development Lifecycle

In recent years, artificial intelligence (AI) has emerged as a transformative force across various industries, and software development is no exception.

March 28, 2024

by Ruchita Varma

· 2,350 Views · 1 Like

DSL Validations: Child Properties

After learning how to validate simple properties on a class, the DSL is extended to allow accessing properties on sub-objects contained within the top-level class.

March 28, 2024

by Scott Sosna

CORE

· 1,824 Views · 1 Like

The Power of LLMs in Java: Leveraging Quarkus and LangChain4j

This post attempts to demystify the use of LLMs in Java, with Quarkus and LangChain4j, across a ludic and hopefully original project.

March 28, 2024

by Nicolas Duminil

CORE

· 6,031 Views · 5 Likes

Caching RESTful API Requests With Heroku Data for Redis

This tutorial walks through how to implement RESTful request caching by deploying a Redis-based system to Heroku.

March 28, 2024

by Michael Bogan

CORE

· 1,502 Views · 1 Like

The End of Data Refactoring?

For “extract/transform/load,” are you transforming your application’s data for the purposes of your applications or the requirements of your database?

March 28, 2024

by Jennifer Reif

CORE

· 2,472 Views · 4 Likes

Enhancing Performance With Amazon Elasticache Redis: In-Depth Insights Into Cluster and Non-Cluster Modes

The article discusses Amazon Elasticache Redis, a managed in-memory caching service that can enhance the performance and user experience of applications.

March 28, 2024

by Satrajit Basu

CORE

· 3,233 Views · 2 Likes

DSL Validations: Properties

Jakarta Bean Validations are a powerful tool to ensure data quality in your objects, but custom, more complex validations can be difficult to maintain.

March 28, 2024

by Scott Sosna

CORE

· 2,753 Views · 1 Like

Advanced-Data Processing With AWS Glue

Discover how AWS Glue, a serverless data integration service, addresses challenges surrounding unstructured data with custom crawlers and built-in classifiers.

March 27, 2024

by Raghava Dittakavi

CORE

· 2,288 Views · 2 Likes

Data Streaming for AI in the Financial Services Industry (Part 2)

Learn the data streaming strategies to lay a solid foundation for AI, moving from chaos and going into order for data strategies.

March 27, 2024

by Christina Lin

CORE

· 1,169 Views · 1 Like

Strategies for Effective Shard Key Selection in Sharded Database Architectures

Explore strategies for selecting the optimal shard key to ensure balanced data distribution, improved query performance, and scalable growth.

March 27, 2024

by Vijay Panwar

CORE

· 1,942 Views · 1 Like

Kotlin Clean Architecture and CQRS

Explore the implementation of Clean Architecture and CQRS microservice using Kotlin, Spring WebFlux with coroutines, PostgreSQL, MongoDB, and Kafka.

March 27, 2024

by Alexander Bryksin

· 2,313 Views · 2 Likes

Types of Data Breaches in Today’s World

It is vital for organizations to be vigilant in carefully selecting the third parties with whom they allow access to sensitive data.

March 27, 2024

by Saurav Bhattacharya

· 2,642 Views · 3 Likes

S3 Cost Savings

Amazon S3 is a fantastically versatile and scalable storage solution, but keeping costs under control is crucial. This blog post dives into key strategies to lower costs.

March 27, 2024

by Rohit Bordia

· 2,259 Views · 4 Likes

Know How To Get Started With LLMs in 2024

As we move into 2024, Large Language Modeling (LLM) will become an essential and fundamental driver of the generative AI space.

March 27, 2024

by Hiren Dhaduk

· 1,388 Views · 1 Like

The Difficulty of SQL Stems From Relational Algebra

This article explores how the fundamental difficulty of SQL actually stems from its theoretical foundation, namely relational algebra.

March 27, 2024

by Judy Liu

· 1,119 Views · 2 Likes

Artificial Intelligence in Data Visualization: Ethics and Trends for 2024

The integration of immersive technologies into data visualization promises to redefine how we interact with and comprehend complex datasets.

March 27, 2024

by Nishan Singh

· 2,184 Views · 2 Likes

Long Tests: Saving All App’s Debug Logs and Writing Your Own Logs

Approach for software QA to troubleshoot bugs using detailed logging — custom and app's debug logs, using Python and Bash scripts for logging and debugging.

March 27, 2024

by Konstantin Sakhchinskiy

· 14,632 Views · 3 Likes

How To Get Started With New Pattern Matching in Java 21

Dive into pattern matching, a powerful new feature in Java 21 that lets you easily deconstruct and analyze data structures. Follow this tutorial for examples.

March 26, 2024

by Daniel Oh

CORE

· 9,369 Views · 15 Likes

Separation of Tenants in Software Design

This article presents the author's point of view on how to separate data, configuration, and other relevant aspects by showing different approaches and discussing them.

March 26, 2024

by Fabian Lemke

· 1,287 Views · 1 Like

Cloud Computing Security: Ensuring Data Protection in the Digital Age

Cloud computing security is vital for protecting data, demanding robust measures to protect data stored and transmitted through cloud service.

March 26, 2024

by faboye michael

· 2,628 Views · 1 Like

The Latest Data Engineering Topics