Data Engineering Resources

Optimizing Data Storage With Hybrid Partitioned Tables in Oracle 19c

Learn how to implement Hybrid Partitioned Tables (HPT) to streamline data management, boost query performance, and cut storage costs.

April 8, 2025

by arvind toorpu

CORE

· 4,192 Views · 3 Likes

Why Rate Limiting Matters in Istio and How to Implement It

In this post, we’ll explore why rate limiting is important in Istio and show you how to set it up effectively.

April 8, 2025

by Josephine Eskaline Joyce

CORE

· 7,859 Views · 9 Likes

AI-Powered Defenses Against Clickjacking in Finance

Clickjacking is not a new online threat, but it continues to evolve and stay relevant. This article discusses AI-driven techniques for combating this attack.

April 8, 2025

by Dipankar Saha

· 2,988 Views

Optimize Slow Data Queries With Doris JOIN Strategies

Today, let's dive into the world of JOIN operations in Doris and see how you can transform your queries into "lightning-fast" operations that will impress your boss!

April 7, 2025

by Zen Hua

· 3,171 Views · 2 Likes

How I Taught OpenAI a New Programming Language With Fine-Tuning

We fine-tuned OpenAI to understand a programming language it had no prior knowledge of. This article explains what we learned.

April 7, 2025

by Thomas Hansen

CORE

· 5,042 Views · 1 Like

Three AI Superpowers: Classification AI vs Predictive AI vs Generative AI

Learn the difference between classification, predictive, and generative AI — what they do and how they’re used to sort data, forecast trends, and create content.

April 7, 2025

by Mahesh Ganesamoorthi

· 3,945 Views

Optimizing Natural Language Queries for Multi-Service Information Retrieval

Learn how to optimize natural language queries for orchestrated information retrieval across multiple services using AI, GraphQL, and embedding models.

April 7, 2025

by Abhay Patra

· 3,590 Views · 1 Like

Implementing Infrastructure as Code (IaC) for Data Center Management

Learn the benefits of infrastructure as code (IaC) for data center management and the best strategies for implementing it.

April 7, 2025

by Zac Amos

· 4,401 Views · 2 Likes

Shift-Right Testing: Smart Automation Through AI and Observability

Shift-right testing uses AI and observability to validate software in production-like environments, helping uncover real-world issues post-release.

April 7, 2025

by Raghavender Vanam

· 3,354 Views · 1 Like

Building a Cost-Effective ELK Stack for Centralized Logging

This tutorial covers the setup of a budget-friendly, secure, and scalable ELK logging platform using Infrastructure as Code (IaC) with Terraform and Ansible.

April 4, 2025

by Pradeep Kumar Goud Gaddamidi

· 9,617 Views · 5 Likes

How Doris and Hive Work Together to Maximize Data Analysis Efficiency

At 3 a.m., the office is filled only with the dim glow of the computer screens. Data engineer Xiao Ming is struggling with two "heavyweights" — Doris and Hive.

April 4, 2025

by Zen Hua

· 4,689 Views · 4 Likes

AI-Driven RAG Systems: Practical Implementation With LangChain

This guide explores the fundamentals of RAG and provides a step-by-step LangChain implementation for building scalable, context-aware AI systems.

April 4, 2025

by Rambabu Bandam

· 9,279 Views · 3 Likes

Achieving Zero Trust and Air-Gapped IaC in IBM Cloud With Schematics

IBM Cloud Schematics enables secure, automated, and policy-driven IaC deployments in air-gapped environments by enforcing zero-trust principles.

April 4, 2025

by Josephine Eskaline Joyce

CORE

· 5,721 Views · 4 Likes

How Doris Connects to Multiple Databases for Federated Analytics and Data Migration

Learn how to use Apache Doris’s JDBC Catalog to connect multiple databases, enable federated analytics, and migrate data efficiently.

April 4, 2025

by li yy

· 5,642 Views · 2 Likes

How to Implement Linked Lists in Go

In this tutorial, learn how different types of linked lists can be implemented using pointers and structure types in Go.

April 3, 2025

by DZone Editorial

· 3,619 Views · 2 Likes

When Doris Learns to "Speak Dialects"

The SQL dialect conversion feature of Apache Doris understands more than ten SQL dialects, including Presto, Trino, Hive, and ClickHouse.

April 3, 2025

by Zen Hua

· 4,524 Views · 3 Likes

Integrating Apache Doris and Hudi for Data Querying and Migration

Learn how to integrate Apache Doris with Apache Hudi for efficient federated querying, real-time analytics, and seamless data migration in big data environments.

April 3, 2025

by li yy

· 5,638 Views · 1 Like

Problem Analysis in Apache Doris StreamLoad Scenarios

Troubleshoot common Apache Doris StreamLoad import errors, including missing partitions, data type mismatches, and special character issues, for smooth syncing.

April 3, 2025

by li yy

· 6,421 Views · 3 Likes

Supercharging LLMs With Knowledge Graphs for Smarter, Fairer AI

KGAT reduces bias in LLMs like GPT-4 by integrating knowledge graphs, enhancing fairness and performance for ethical AI systems.

April 3, 2025

by Rajeev Kumar

· 3,956 Views · 2 Likes

From Zero to Meme Hero: How I Built an AI-Powered Meme Generator in React

Learn how to build an AI meme generator using OpenAI, React, Fabric.js, and DALL-E 3 and create captions, design meme canvases, and optimize costs and performance.

April 3, 2025

by Mohit Menghnani

CORE

· 7,356 Views · 4 Likes

The Latest Data Engineering Topics