Data Engineering Resources

For “extract/transform/load,” are you transforming your application’s data for the purposes of your applications or the requirements of your database?

March 28, 2024

by Jennifer Reif

CORE

· 1,878 Views · 4 Likes

Enhancing Performance With Amazon Elasticache Redis: In-Depth Insights Into Cluster and Non-Cluster Modes

The article discusses Amazon Elasticache Redis, a managed in-memory caching service that can enhance the performance and user experience of applications.

March 28, 2024

by Satrajit Basu

CORE

· 2,148 Views · 1 Like

DSL Validations: Properties

Jakarta Bean Validations are a powerful tool to ensure data quality in your objects, but custom, more complex validations can be difficult to maintain.

March 28, 2024

by Scott Sosna

CORE

· 2,142 Views · 1 Like

Advanced-Data Processing With AWS Glue

Discover how AWS Glue, a serverless data integration service, addresses challenges surrounding unstructured data with custom crawlers and built-in classifiers.

March 27, 2024

by Raghava Dittakavi

CORE

· 997 Views · 2 Likes

Data Streaming for AI in the Financial Services Industry (Part 2)

Learn the data streaming strategies to lay a solid foundation for AI, moving from chaos and going into order for data strategies.

March 27, 2024

by Christina Lin

CORE

· 717 Views · 1 Like

Strategies for Effective Shard Key Selection in Sharded Database Architectures

Explore strategies for selecting the optimal shard key to ensure balanced data distribution, improved query performance, and scalable growth.

March 27, 2024

by Vijay Panwar

CORE

· 827 Views · 1 Like

Kotlin Clean Architecture and CQRS

Explore the implementation of Clean Architecture and CQRS microservice using Kotlin, Spring WebFlux with coroutines, PostgreSQL, MongoDB, and Kafka.

March 27, 2024

by Alexander Bryksin

· 1,810 Views · 2 Likes

Types of Data Breaches in Today’s World

It is vital for organizations to be vigilant in carefully selecting the third parties with whom they allow access to sensitive data.

March 27, 2024

by Saurav Bhattacharya

· 1,764 Views · 3 Likes

S3 Cost Savings

Amazon S3 is a fantastically versatile and scalable storage solution, but keeping costs under control is crucial. This blog post dives into key strategies to lower costs.

March 27, 2024

by Rohit Bordia

· 1,535 Views · 4 Likes

Know How To Get Started With LLMs in 2024

As we move into 2024, Large Language Modeling (LLM) will become an essential and fundamental driver of the generative AI space.

March 27, 2024

by Hiren Dhaduk

· 862 Views · 1 Like

The Difficulty of SQL Stems From Relational Algebra

This article explores how the fundamental difficulty of SQL actually stems from its theoretical foundation, namely relational algebra.

March 27, 2024

by Judy Liu

· 745 Views · 2 Likes

Artificial Intelligence in Data Visualization: Ethics and Trends for 2024

The integration of immersive technologies into data visualization promises to redefine how we interact with and comprehend complex datasets.

March 27, 2024

by Nishan Singh

· 1,265 Views · 2 Likes

Long Tests: Saving All App’s Debug Logs and Writing Your Own Logs

Approach for software QA to troubleshoot bugs using detailed logging — custom and app's debug logs, using Python and Bash scripts for logging and debugging.

March 27, 2024

by Konstantin Sakhchinskiy

· 13,751 Views · 3 Likes

How To Get Started With New Pattern Matching in Java 21

Dive into pattern matching, a powerful new feature in Java 21 that lets you easily deconstruct and analyze data structures. Follow this tutorial for examples.

March 26, 2024

by Daniel Oh

CORE

· 7,894 Views · 15 Likes

Separation of Tenants in Software Design

This article presents the author's point of view on how to separate data, configuration, and other relevant aspects by showing different approaches and discussing them.

March 26, 2024

by Fabian Lemke

· 996 Views · 1 Like

Cloud Computing Security: Ensuring Data Protection in the Digital Age

Cloud computing security is vital for protecting data, demanding robust measures to protect data stored and transmitted through cloud service.

March 26, 2024

by faboye michael

· 1,604 Views · 1 Like

Navigating the Digital Frontier: A Journey Through Information Technology Progress

Embark on a journey through the key milestones and advancements that have shaped the IT landscape, exploring the technologies driving progress and the implications.

March 26, 2024

by Santosh Sahu

· 1,729 Views · 2 Likes

Unlocking IoT Security: Transitioning to Zero-Trust Architecture Simplified

Transitioning to a Zero Trust Architecture (ZTA) for IoT security involves eliminating implicit trust and continuously validating every stage of a digital interaction.

March 26, 2024

by Deep Manishkumar Dave

· 1,388 Views · 2 Likes

Building Ethical AI Starts With the Data Team, Here’s Why

GenAI is an ethical quagmire. What responsibility do data leaders have to navigate it? We consider the need for ethical AI and why data ethics are AI ethics.

March 26, 2024

by Lior Gavish

· 1,063 Views · 1 Like

Automating AWS Infrastructure: Creating API Gateway, NLB, Security Group, and VPC With CloudFormation

In modern cloud environments, Infrastructure as Code (IaC) has become a cornerstone for managing and provisioning resources efficiently

March 26, 2024

by Vijay Panwar

CORE

· 1,325 Views · 2 Likes

The Latest Data Engineering Topics