Data Engineering Resources

Alipay: Large-Scale Model Training on Billions of Files

Chuanying Chen provides a deep dive into the practices of reliable, scalable, and high-performance large-scale training on billions of files.

June 5, 2023

by ccy lu

· 2,137 Views · 2 Likes

Hiding Data in Cassandra

In this article, take a walk through 3 basic approaches to learn how to roll your own data masking for Cassandra-compatible databases using off-the-shelf tools.

June 5, 2023

by Max Tardiveau

· 2,743 Views · 4 Likes

Leveraging FastAPI for Building Secure and High-Performance Banking APIs

Explore the importance of FastAPI for developing banking APIs and how it can empower financial institutions to deliver efficient and secure services to their customers.

June 5, 2023

by Amlan Patnaik

· 3,557 Views · 3 Likes

Understanding Dependencies...Visually!

Whether from the command line or within an IDE, understanding your project's dependencies is challenging because it's text-based. Are there alternatives?

June 5, 2023

by Scott Sosna

CORE

· 5,160 Views · 5 Likes

User Safety and Privacy Protection in the Age of AI Chatbots in Healthcare

The use of AI chatbots in healthcare necessitates a comprehensive approach to address vital considerations to avoid critical issues.

June 5, 2023

by Frederic Jacquet

CORE

· 2,197 Views · 1 Like

AI and Cybersecurity Protecting Against Emerging Threats

Discover how AI and cybersecurity work together to shield against emerging threats. Learn the latest strategies for protecting your digital assets.

June 5, 2023

by Muhammad Muzammil Rawjani

· 6,003 Views · 9 Likes

Microservices With Apache Camel and Quarkus (Part 2)

Take a look at a scenario to deploy and run locally the simplified money transfer application presented in part 1 as Quarkus standalone services.

June 3, 2023

by Nicolas Duminil

CORE

· 10,241 Views · 2 Likes

How To Use Geo-Partitioning to Comply With Data Regulations and Deliver Low Latency Globally

Read a geo-partitioning guide to deploying a YugabyteDB Managed database cluster and optimizing data distribution across regions.

June 2, 2023

by Denis Magda

CORE

· 5,884 Views · 2 Likes

Health Check Response Format for HTTP APIs

Continue a journey of getting more familiar with HTTP APIs and learn about a great initiative to standardize health checks across the industry.

June 2, 2023

by Nicolas Fränkel

CORE

· 5,413 Views · 6 Likes

Constructing Real-Time Analytics: Fundamental Components and Architectural Framework — Part 2

The fundamental components of real-time analytics are event streaming and a specialized database that can manage large amounts of data in less than a second.

June 2, 2023

by David Wang

· 4,040 Views · 2 Likes

Step Into Serverless Computing

This article provides a detailed overview of serverless architecture, including the benefits, challenges, and best practices of serverless computing.

June 2, 2023

by Narasimha Rao Konangi

· 5,921 Views · 4 Likes

A React Frontend With Go/Gin/Gorm Backend in One Project

In this article, the reader will learn more about how to build a Go Project with React Frontend and a PostgreSQL database.

June 2, 2023

by Sven Loesekann

· 6,212 Views · 5 Likes

Azure Virtual Machines

In this article, we will explore the capabilities of Azure VMs and delve into their key features and benefits, along with practical use cases.

June 2, 2023

by Sridhar Mannava

· 4,064 Views · 2 Likes

Automating Data Quality Check in Data Pipelines

Are you looking for ways to automate data quality checks in your data pipelines? Here are some helpful tools that can streamline the process for you.

June 2, 2023

by Hardik Shah

· 4,111 Views · 1 Like

How To Approach Java, Databases, and SQL [Video]

Learn how to save thumbnail data to a database to render our pictures to a nice HTML gallery page and finish the proof of concept for our Google Photos clone.

June 2, 2023

by Marco Behler

CORE

· 6,849 Views · 6 Likes

Effective Java Collection Framework: Best Practices and Tips

In this blog, we learn effectively use the Java Collection Framework, consider factors like utilizing the enhanced for loop, generics, and avoiding raw types.

June 1, 2023

by Shailendra Bramhvanshi

· 13,198 Views · 10 Likes

Turbocharge Ab Initio ETL Pipelines: Simple Tweaks for Maximum Performance Boost

Best practices and design considerations for Ab Initio graphs, along with performance enhancement tips and code snippet(s).

June 1, 2023

by Sivakumar Ponnusamy

· 4,141 Views · 3 Likes

How To Use an Automatic Sequence Diagram Generator

Sequence diagrams are useful for modeling and visualizing complex interactions between objects in a system. Learn how to generate them with the developer tool.

June 1, 2023

by Adam Trotta

· 3,331 Views · 1 Like

Internationalization and Localization: The Challenges

This article summarizes the challenges that the development team will encounter when implementing software with localization and internationalization support

June 1, 2023

by Pavel Micka

· 2,327 Views · 1 Like

Leveraging RuntimeFabric To Deploy Mule Runtime to AWS (EKS)

This article provides the prescriptive steps to migrating Mule Cloudhub to RTF on EKS Deployment Model. It also describes changes to the application, process, and more.

June 1, 2023

by Abhay Patra

· 4,156 Views · 2 Likes

The Latest Data Engineering Topics