Data Engineering Resources

Understanding the Purposes of Key Terraform Files and How to Structure Their Folders

Understand the role and function of critical Terraform files and structure their folders to optimize the efficiency and scalability of your cloud resources.

September 12, 2024

by Ryan Kh

· 5,088 Views · 1 Like

How to Build an OpenAI Custom GPT With a Third-Party API

This tutorial demonstrates how to build a conversational user interface with OpenAI's Custom GPT using any third-party API.

September 12, 2024

by Akhilesh Joshi

· 4,191 Views · 2 Likes

10 Things to Avoid in Domain-Driven Design (DDD)

DDD is an important strategic approach to software development. In this article, explore 10 things to avoid in DDD and examples to illustrate these pitfalls.

September 12, 2024

by Reza Ganji

CORE

· 11,099 Views · 12 Likes

Understanding Floating-Point Precision Issues in Java

In Java, there are two types of floating-point numbers: float and double. Follow an explanation about why floating numbers in Java is not what you might expect.

September 12, 2024

by Dmitry Egorov

CORE

· 6,994 Views · 13 Likes

Optimizing Data Management for AI Success: Industry Insights and Best Practices

Explore key strategies for effective data management in AI projects, including real-time access, federated queries, and data literacy for developers and engineers.

September 11, 2024

by Tom Smith

CORE

· 4,287 Views · 1 Like

How Stalactite ORM Implements Its Fluent DSL

Target the goal of getting expressive code: leveraging Java Proxy technology to implement an intuitive and fluent DSL to enhance the user-developer experience.

September 11, 2024

by Guillaume Mary

· 5,269 Views · 1 Like

Optimizing Container Synchronization for Frequent Writes

Enhance multi-threaded container synchronization by implementing sharding techniques, improving performance and scalability in high-frequency write operations.

September 11, 2024

by Alexander Iskhakov

· 8,008 Views · 5 Likes

8 Practices Software Engineers Should Adopt and Champion for Cybersecurity

Surprisingly, cybersecurity could be as simple as following best practices, which ideally should be integrated into the culture itself. Learn more in this post.

September 11, 2024

by Manish Sinha

· 4,607 Views · 3 Likes

The Significance of Complex Event Processing (CEP) With RisingWave for Delivering Accurate Business Decisions

Learn more about CEP, how it addresses a key challenge in real-time processing by detecting patterns in data streams, and compare FlinkCEP and RisingWave.

September 11, 2024

by Gautam Goswami

CORE

· 4,548 Views · 1 Like

Real-Time GenAI With RAG Using Apache Kafka and Flink to Prevent Hallucinations

Learn about context-specific real-time Generative AI (GenAI) with Retrieval Augmentation Generation (RAG) using Kafka and Flink to prevent hallucinations.

September 11, 2024

by Kai Wähner

CORE

· 3,223 Views · 1 Like

Automatic 1111: Custom Sketch-to-Image API

Develop a custom Sketch-to-Image API for converting hand-drawn/digital sketches into photorealistic images using stable diffusion models powered by ControlNet.

September 10, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 3,544 Views · 3 Likes

Exploring Real-Time Data Ingestion Into Snowflake Using CockroachDB, Redpanda, and Kafka Connect

Explore Kafka Connect as a solution to stream changefeeds into Snowflake for greater control over how messages are delivered to Snowflake.

September 10, 2024

by Artem Ervits

CORE

· 5,180 Views · 1 Like

REST and HTTP Semantics

Discover if the benefits of using PUT and POST as described in the RFC outweigh whatever reasons for using them in a way that is not RFC-compliant.

September 10, 2024

by Greg Hall

· 5,273 Views · 3 Likes

Explainable AI (XAI): How Developers Build Trust and Transparency in AI Systems

XAI is essential for making AI systems transparent, trustworthy, and ethically compliant, with developers playing a crucial role.

September 10, 2024

by Suri Nuthalapati

CORE

· 47,337 Views · 3 Likes

Transforming Continuous Delivery With Feature Flags

Integrate feature flags into CI/CD pipelines to mitigate deployment risks, ensure safer feature rollouts, and facilitate feature testing.

September 10, 2024

by Josephine Eskaline Joyce

CORE

· 5,817 Views · 8 Likes

Accelerate Your Journey to a Modern Data Platform Using Coalesce

This article will identify key challenges organizations face today in managing data platforms, and explore how advanced ETL tools can address these challenges.

September 10, 2024

by Asia Banu Shaik

· 4,561 Views · 5 Likes

Digital Garden

This article is dedicated to the concept of a digital garden — the philosophy of publicly maintaining personal notes.

September 10, 2024

by Anton Belyaev

· 4,216 Views · 2 Likes

How Can the Scalability of MySQL Be Improved for BenchmarkSQL TPC-C Testing?

Can MySQL maintain performance without collapse at tens of thousands of concurrent connections in low-conflict scenarios of BenchmarkSQL TPC-C testing?

September 10, 2024

by Bin Wang

· 2,851 Views · 1 Like

Mastering Multi-Cloud and Edge Data Synchronization: A Retail Use Case With KubeMQ’s Java SDK

Explore how KubeMQ’s open-source Java SDK provides a powerful solution for enterprises looking to manage data across complex multi-cloud and edge environments.

September 10, 2024

by John Vester

CORE

· 35,471 Views · 2 Likes

Top Security Flaws Hiding in Your Code Right Now and How to Fix Them

This article examines the three most common injection attack types: SQL injection, Deserialization Injection, and Logging Injection — and discusses ways to prevent them.

September 10, 2024

by Jonathan Vila

· 4,281 Views · 3 Likes

The Latest Data Engineering Topics