Data Engineering Resources

Event-Driven Architecture Using Serverless Technologies

Event-driven architecture (EDA) design pattern uses events to determine which parts of the software to execute.

June 5, 2023

by Maharshi Jha

· 4,975 Views · 1 Like

Alipay: Large-Scale Model Training on Billions of Files

Chuanying Chen provides a deep dive into the practices of reliable, scalable, and high-performance large-scale training on billions of files.

June 5, 2023

by ccy lu

· 2,413 Views · 2 Likes

Hiding Data in Cassandra

In this article, take a walk through 3 basic approaches to learn how to roll your own data masking for Cassandra-compatible databases using off-the-shelf tools.

June 5, 2023

by Max Tardiveau

· 3,076 Views · 4 Likes

Leveraging FastAPI for Building Secure and High-Performance Banking APIs

Explore the importance of FastAPI for developing banking APIs and how it can empower financial institutions to deliver efficient and secure services to their customers.

June 5, 2023

by Amlan Patnaik

· 4,683 Views · 4 Likes

Understanding Dependencies...Visually!

Whether from the command line or within an IDE, understanding your project's dependencies is challenging because it's text-based. Are there alternatives?

June 5, 2023

by Scott Sosna

CORE

· 6,502 Views · 5 Likes

User Safety and Privacy Protection in the Age of AI Chatbots in Healthcare

The use of AI chatbots in healthcare necessitates a comprehensive approach to address vital considerations to avoid critical issues.

June 5, 2023

by Frederic Jacquet

CORE

· 2,618 Views · 3 Likes

AI and Cybersecurity Protecting Against Emerging Threats

Discover how AI and cybersecurity work together to shield against emerging threats. Learn the latest strategies for protecting your digital assets.

June 5, 2023

by Muhammad Muzammil Rawjani

· 7,026 Views · 9 Likes

Microservices With Apache Camel and Quarkus (Part 2)

Take a look at a scenario to deploy and run locally the simplified money transfer application presented in part 1 as Quarkus standalone services.

June 3, 2023

by Nicolas Duminil

CORE

· 11,186 Views · 2 Likes

How To Use Geo-Partitioning to Comply With Data Regulations and Deliver Low Latency Globally

Read a geo-partitioning guide to deploying a YugabyteDB Managed database cluster and optimizing data distribution across regions.

June 2, 2023

by Denis Magda

CORE

· 7,091 Views · 2 Likes

Health Check Response Format for HTTP APIs

Continue a journey of getting more familiar with HTTP APIs and learn about a great initiative to standardize health checks across the industry.

May 25, 2023

by Nicolas Fränkel

· 6,219 Views · 6 Likes

Constructing Real-Time Analytics: Fundamental Components and Architectural Framework — Part 2

The fundamental components of real-time analytics are event streaming and a specialized database that can manage large amounts of data in less than a second.

June 2, 2023

by David Wang

· 5,219 Views · 2 Likes

Step Into Serverless Computing

This article provides a detailed overview of serverless architecture, including the benefits, challenges, and best practices of serverless computing.

June 2, 2023

by Narasimha Rao Konangi

· 6,664 Views · 4 Likes

A React Frontend With Go/Gin/Gorm Backend in One Project

In this article, the reader will learn more about how to build a Go Project with React Frontend and a PostgreSQL database.

June 2, 2023

by Sven Loesekann

· 6,862 Views · 5 Likes

Azure Virtual Machines

In this article, we will explore the capabilities of Azure VMs and delve into their key features and benefits, along with practical use cases.

June 2, 2023

by Sridhar Mannava

· 5,848 Views · 2 Likes

Automating Data Quality Check in Data Pipelines

Are you looking for ways to automate data quality checks in your data pipelines? Here are some helpful tools that can streamline the process for you.

June 2, 2023

by Hardik Shah

· 5,128 Views · 1 Like

How To Approach Java, Databases, and SQL [Video]

Learn how to save thumbnail data to a database to render our pictures to a nice HTML gallery page and finish the proof of concept for our Google Photos clone.

June 2, 2023

by Marco Behler

· 7,776 Views · 6 Likes

Effective Java Collection Framework: Best Practices and Tips

In this blog, we learn effectively use the Java Collection Framework, consider factors like utilizing the enhanced for loop, generics, and avoiding raw types.

June 1, 2023

by Shailendra Bramhvanshi

· 15,230 Views · 10 Likes

Turbocharge Ab Initio ETL Pipelines: Simple Tweaks for Maximum Performance Boost

Best practices and design considerations for Ab Initio graphs, along with performance enhancement tips and code snippet(s).

June 1, 2023

by Sivakumar Ponnusamy

· 5,920 Views · 4 Likes

How To Use an Automatic Sequence Diagram Generator

Sequence diagrams are useful for modeling and visualizing complex interactions between objects in a system. Learn how to generate them with the developer tool.

June 1, 2023

by Adam Trotta

· 3,693 Views · 1 Like

Internationalization and Localization: The Challenges

This article summarizes the challenges that the development team will encounter when implementing software with localization and internationalization support

June 1, 2023

by Pavel Micka

· 2,589 Views · 1 Like

The Latest Data Engineering Topics