Data Engineering Resources

The Ultimate Database Scaling Cheatsheet: Strategies for Optimizing Performance and Scalability

Enhance performance and scalability using database scaling strategies like indexing, vertical scaling, sharding, denormalization, caching, and replication.

September 16, 2024

by Suleiman Dibirov

CORE

· 10,849 Views · 9 Likes

Leveling Up My GraphQL Skills: Real-Time Subscriptions

Dive a little deeper to explore real-time data subscriptions by using GraphQL to automatically receive server-side updates with help from a WebSocket consumer.

September 16, 2024

by John Vester

CORE

· 60,901 Views · 2 Likes

Retrieval-Augmented Generation (RAG): Enhancing AI-Language Models With Real-World Knowledge

In this post, we'll take a closer look at RAG, how it works, where it's being used, and how it might change our interactions with AI in the future.

September 16, 2024

by Mohan Krishna Mannava

· 3,887 Views · 2 Likes

Obfuscation vs Encryption: How to Protect Your .NET Code the Right Way

Are you confused between obfuscation and encryption or when to use each technique? Read this guide to get a clear understanding of obfuscation and encryption.

September 16, 2024

by Madiha Jamal

· 5,260 Views · 1 Like

How to Merge Excel XLSX Files in Java

This article discusses programmatically merging XLSX files into a single document as well as open-source and web API solutions for automating this workflow.

September 16, 2024

by Brian O'Neill

CORE

· 7,931 Views · 2 Likes

Zero to AI Hero, Part 3: Unleashing the Power of Agents in Semantic Kernel

This article will guide you through building agents with Semantic Kernel, focusing on the key components and offering practical examples.

September 16, 2024

by Aneesh Gopalakrishnan

· 9,055 Views · 1 Like

Releasing MuleSoft API

In this tutorial, learn how to set up MuleSoft environment-related deployment folders and tag the release version with custom-generated tags.

September 13, 2024

by Ash singh

· 5,581 Views · 4 Likes

Setting Up Secure Data Lakes for Starlight Financial: A Guide to AWS Implementation

This guide delves into securing financial data lakes with AWS services, focusing on best practices for data protection and compliance.

September 13, 2024

by Harsh Daiya

CORE

· 5,977 Views · 2 Likes

The Critical Role of Data at Rest Encryption in Cybersecurity

Data at rest encryption is vital in cybersecurity, securing stored data from unauthorized access and breaches. It ensures that even if data is stolen, it remains unreadable.

September 13, 2024

by Favour Efeoghene

· 5,124 Views · 2 Likes

Understanding the Purposes of Key Terraform Files and How to Structure Their Folders

Understand the role and function of critical Terraform files and structure their folders to optimize the efficiency and scalability of your cloud resources.

September 12, 2024

by Ryan Kh

· 6,290 Views · 1 Like

How to Build an OpenAI Custom GPT With a Third-Party API

This tutorial demonstrates how to build a conversational user interface with OpenAI's Custom GPT using any third-party API.

September 12, 2024

by Akhilesh Joshi

· 7,693 Views · 2 Likes

10 Things to Avoid in Domain-Driven Design (DDD)

DDD is an important strategic approach to software development. In this article, explore 10 things to avoid in DDD and examples to illustrate these pitfalls.

September 12, 2024

by Reza Ganji

CORE

· 16,099 Views · 13 Likes

Understanding Floating-Point Precision Issues in Java

In Java, there are two types of floating-point numbers: float and double. Follow an explanation about why floating numbers in Java is not what you might expect.

September 12, 2024

by Dmitry Egorov

CORE

· 10,914 Views · 14 Likes

Optimizing Data Management for AI Success: Industry Insights and Best Practices

Explore key strategies for effective data management in AI projects, including real-time access, federated queries, and data literacy for developers and engineers.

September 11, 2024

by Tom Smith

CORE

· 5,974 Views · 2 Likes

How Stalactite ORM Implements Its Fluent DSL

Target the goal of getting expressive code: leveraging Java Proxy technology to implement an intuitive and fluent DSL to enhance the user-developer experience.

September 11, 2024

by Guillaume Mary

· 6,786 Views · 2 Likes

Optimizing Container Synchronization for Frequent Writes

Enhance multi-threaded container synchronization by implementing sharding techniques, improving performance and scalability in high-frequency write operations.

September 11, 2024

by Alexander Iskhakov

· 14,057 Views · 95 Likes

8 Practices Software Engineers Should Adopt and Champion for Cybersecurity

Surprisingly, cybersecurity could be as simple as following best practices, which ideally should be integrated into the culture itself. Learn more in this post.

September 11, 2024

by Manish Sinha

· 6,336 Views · 3 Likes

The Significance of Complex Event Processing (CEP) With RisingWave for Delivering Accurate Business Decisions

Learn more about CEP, how it addresses a key challenge in real-time processing by detecting patterns in data streams, and compare FlinkCEP and RisingWave.

September 11, 2024

by Gautam Goswami

CORE

· 6,626 Views · 2 Likes

Real-Time GenAI With RAG Using Apache Kafka and Flink to Prevent Hallucinations

Learn about context-specific real-time Generative AI (GenAI) with Retrieval Augmentation Generation (RAG) using Kafka and Flink to prevent hallucinations.

September 11, 2024

by Kai Wähner

CORE

· 4,953 Views · 3 Likes

Automatic 1111: Custom Sketch-to-Image API

Develop a custom Sketch-to-Image API for converting hand-drawn/digital sketches into photorealistic images using stable diffusion models powered by ControlNet.

September 10, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 6,020 Views · 6 Likes

The Latest Data Engineering Topics