Data Engineering Resources

Explore how to master high-load systems with custom solutions, caching, scalable architecture, and continuous optimization to handle millions of users.

September 17, 2024

by Alexander Kolobov

· 19,627 Views · 65 Likes

Algorithmic Advances in AI-Driven Search: Optimizing Query Processing for Precision and Speed

Explore concepts of AI-driven query processing, key algorithms that enhance search performance, and best practices for optimizing AI-powered retrieval systems.

September 17, 2024

by Lav Kumar

· 2,640 Views · 2 Likes

Database Keys: A Comprehensive Guide

Database keys are crucial for organizing and retrieving data efficiently. This guide provides a quick rundown of the main types.

September 17, 2024

by Brij kishore Pandey

· 3,969 Views · 1 Like

A Hands-On Guide to OpenTelemetry: Manual Instrumentation for Developers

This article continues the series by explaining how to manually instrument your application's telemetry data on your observability journey.

September 17, 2024

by Eric D. Schabell

CORE

· 3,620 Views · 2 Likes

Commonly Occurring Errors in Microsoft Graph Integrations and How To Troubleshoot Them (Part 6)

Explore an example to change a column value for a list item of a “user-defined” SharePoint list using a DriveItem, which also represents the PDF file.

September 16, 2024

by Constantin Kwiatkowski

· 3,446 Views · 1 Like

Observability Agent Architecture

Explore these practices to build efficient, trustworthy, and safe software agents to provide observability for customer applications.

September 16, 2024

by Kranthi Kiran Erusu

· 7,994 Views · 6 Likes

Low-Level Optimizations in ClickHouse: Utilizing Branch Prediction and SIMD To Speed Up Query Execution

ClickHouse accelerates queries using SIMD and optimizes block processing. It picks the best function implementation, boosting performance on AVX2 processors.

September 16, 2024

by Taras Baranyuk

CORE

· 4,517 Views · 3 Likes

Build an Advanced RAG App: Query Routing

This article explores what query routing is in the context of a RAG application and how to set up a query routing mechanism with a simple case study.

September 16, 2024

by Roger Oriol

· 5,079 Views · 6 Likes

The Ultimate Database Scaling Cheatsheet: Strategies for Optimizing Performance and Scalability

Enhance performance and scalability using database scaling strategies like indexing, vertical scaling, sharding, denormalization, caching, and replication.

September 16, 2024

by Suleiman Dibirov

CORE

· 7,944 Views · 8 Likes

Leveling Up My GraphQL Skills: Real-Time Subscriptions

Dive a little deeper to explore real-time data subscriptions by using GraphQL to automatically receive server-side updates with help from a WebSocket consumer.

September 16, 2024

by John Vester

CORE

· 59,267 Views · 2 Likes

Retrieval-Augmented Generation (RAG): Enhancing AI-Language Models With Real-World Knowledge

In this post, we'll take a closer look at RAG, how it works, where it's being used, and how it might change our interactions with AI in the future.

September 16, 2024

by Mohan Krishna Mannava

· 2,549 Views · 2 Likes

Obfuscation vs Encryption: How to Protect Your .NET Code the Right Way

Are you confused between obfuscation and encryption or when to use each technique? Read this guide to get a clear understanding of obfuscation and encryption.

September 16, 2024

by Madiha Jamal

· 3,212 Views · 1 Like

How to Merge Excel XLSX Files in Java

This article discusses programmatically merging XLSX files into a single document as well as open-source and web API solutions for automating this workflow.

September 16, 2024

by Brian O'Neill

CORE

· 6,383 Views · 2 Likes

Zero to AI Hero, Part 3: Unleashing the Power of Agents in Semantic Kernel

This article will guide you through building agents with Semantic Kernel, focusing on the key components and offering practical examples.

September 16, 2024

by Aneesh Gopalakrishnan

· 6,115 Views · 1 Like

Releasing MuleSoft API

In this tutorial, learn how to set up MuleSoft environment-related deployment folders and tag the release version with custom-generated tags.

September 13, 2024

by Ash singh

· 4,395 Views · 4 Likes

Setting Up Secure Data Lakes for Starlight Financial: A Guide to AWS Implementation

This guide delves into securing financial data lakes with AWS services, focusing on best practices for data protection and compliance.

September 13, 2024

by Harsh Daiya

CORE

· 4,897 Views · 1 Like

The Critical Role of Data at Rest Encryption in Cybersecurity

Data at rest encryption is vital in cybersecurity, securing stored data from unauthorized access and breaches. It ensures that even if data is stolen, it remains unreadable.

September 13, 2024

by Favour Efeoghene

· 3,894 Views · 2 Likes

Understanding the Purposes of Key Terraform Files and How to Structure Their Folders

Understand the role and function of critical Terraform files and structure their folders to optimize the efficiency and scalability of your cloud resources.

September 12, 2024

by Ryan Kh

· 5,310 Views · 1 Like

How to Build an OpenAI Custom GPT With a Third-Party API

This tutorial demonstrates how to build a conversational user interface with OpenAI's Custom GPT using any third-party API.

September 12, 2024

by Akhilesh Joshi

· 4,810 Views · 2 Likes

10 Things to Avoid in Domain-Driven Design (DDD)

DDD is an important strategic approach to software development. In this article, explore 10 things to avoid in DDD and examples to illustrate these pitfalls.

September 12, 2024

by Reza Ganji

CORE

· 12,064 Views · 13 Likes

The Latest Data Engineering Topics