Data Engineering Resources

Releasing MuleSoft API

In this tutorial, learn how to set up MuleSoft environment-related deployment folders and tag the release version with custom-generated tags.

September 13, 2024

by Ash singh

· 4,251 Views · 4 Likes

Setting Up Secure Data Lakes for Starlight Financial: A Guide to AWS Implementation

This guide delves into securing financial data lakes with AWS services, focusing on best practices for data protection and compliance.

September 13, 2024

by Harsh Daiya

CORE

· 4,720 Views · 1 Like

The Critical Role of Data at Rest Encryption in Cybersecurity

Data at rest encryption is vital in cybersecurity, securing stored data from unauthorized access and breaches. It ensures that even if data is stolen, it remains unreadable.

September 13, 2024

by Favour Efeoghene

· 3,726 Views · 2 Likes

Understanding the Purposes of Key Terraform Files and How to Structure Their Folders

Understand the role and function of critical Terraform files and structure their folders to optimize the efficiency and scalability of your cloud resources.

September 12, 2024

by Ryan Kh

· 5,162 Views · 1 Like

How to Build an OpenAI Custom GPT With a Third-Party API

This tutorial demonstrates how to build a conversational user interface with OpenAI's Custom GPT using any third-party API.

September 12, 2024

by Akhilesh Joshi

· 4,381 Views · 2 Likes

10 Things to Avoid in Domain-Driven Design (DDD)

DDD is an important strategic approach to software development. In this article, explore 10 things to avoid in DDD and examples to illustrate these pitfalls.

September 12, 2024

by Reza Ganji

CORE

· 11,569 Views · 12 Likes

Understanding Floating-Point Precision Issues in Java

In Java, there are two types of floating-point numbers: float and double. Follow an explanation about why floating numbers in Java is not what you might expect.

September 12, 2024

by Dmitry Egorov

CORE

· 7,150 Views · 14 Likes

Optimizing Data Management for AI Success: Industry Insights and Best Practices

Explore key strategies for effective data management in AI projects, including real-time access, federated queries, and data literacy for developers and engineers.

September 11, 2024

by Tom Smith

CORE

· 4,393 Views · 1 Like

How Stalactite ORM Implements Its Fluent DSL

Target the goal of getting expressive code: leveraging Java Proxy technology to implement an intuitive and fluent DSL to enhance the user-developer experience.

September 11, 2024

by Guillaume Mary

· 5,374 Views · 1 Like

Optimizing Container Synchronization for Frequent Writes

Enhance multi-threaded container synchronization by implementing sharding techniques, improving performance and scalability in high-frequency write operations.

September 11, 2024

by Alexander Iskhakov

· 12,779 Views · 95 Likes

8 Practices Software Engineers Should Adopt and Champion for Cybersecurity

Surprisingly, cybersecurity could be as simple as following best practices, which ideally should be integrated into the culture itself. Learn more in this post.

September 11, 2024

by Manish Sinha

· 4,769 Views · 3 Likes

The Significance of Complex Event Processing (CEP) With RisingWave for Delivering Accurate Business Decisions

Learn more about CEP, how it addresses a key challenge in real-time processing by detecting patterns in data streams, and compare FlinkCEP and RisingWave.

September 11, 2024

by Gautam Goswami

CORE

· 4,602 Views · 1 Like

Real-Time GenAI With RAG Using Apache Kafka and Flink to Prevent Hallucinations

Learn about context-specific real-time Generative AI (GenAI) with Retrieval Augmentation Generation (RAG) using Kafka and Flink to prevent hallucinations.

September 11, 2024

by Kai Wähner

CORE

· 3,380 Views · 1 Like

Automatic 1111: Custom Sketch-to-Image API

Develop a custom Sketch-to-Image API for converting hand-drawn/digital sketches into photorealistic images using stable diffusion models powered by ControlNet.

September 10, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 3,709 Views · 3 Likes

Exploring Real-Time Data Ingestion Into Snowflake Using CockroachDB, Redpanda, and Kafka Connect

Explore Kafka Connect as a solution to stream changefeeds into Snowflake for greater control over how messages are delivered to Snowflake.

September 10, 2024

by Artem Ervits

CORE

· 5,265 Views · 1 Like

REST and HTTP Semantics

Discover if the benefits of using PUT and POST as described in the RFC outweigh whatever reasons for using them in a way that is not RFC-compliant.

September 10, 2024

by Greg Hall

· 5,421 Views · 3 Likes

Explainable AI (XAI): How Developers Build Trust and Transparency in AI Systems

XAI is essential for making AI systems transparent, trustworthy, and ethically compliant, with developers playing a crucial role.

September 10, 2024

by Suri Nuthalapati

CORE

· 47,407 Views · 3 Likes

Transforming Continuous Delivery With Feature Flags

Integrate feature flags into CI/CD pipelines to mitigate deployment risks, ensure safer feature rollouts, and facilitate feature testing.

September 10, 2024

by Josephine Eskaline Joyce

CORE

· 5,923 Views · 8 Likes

Accelerate Your Journey to a Modern Data Platform Using Coalesce

This article will identify key challenges organizations face today in managing data platforms, and explore how advanced ETL tools can address these challenges.

September 10, 2024

by Asia Banu Shaik

· 4,697 Views · 5 Likes

Digital Garden

This article is dedicated to the concept of a digital garden — the philosophy of publicly maintaining personal notes.

September 10, 2024

by Anton Belyaev

· 4,328 Views · 2 Likes

The Latest Data Engineering Topics