Data Engineering Resources

Use JWT tokens for fine-grained access control while avoiding direct inclusion of PII-like account numbers. Use non-PII identifiers and perform server-side lookup.

June 5, 2024

by Abhishek Goswami

· 5,375 Views · 3 Likes

I Built a Reusable Dashboard for Read the Docs Traffic Analytics Using Vizro-AI

This article explores a simple, low code, and open-source solution to build a dashboard to visualize traffic data for documentation.

June 4, 2024

by Jo Stichbury

CORE

· 2,860 Views · 1 Like

LLMs Get a Memory Boost with HippoRAG

HippoRAG, a new RAG framework, uses a knowledge graph to represent connections between concepts, enabling LLMs to reason and provide more accurate, nuanced answers.

June 4, 2024

by Indrajit Bhattacharya

· 4,033 Views · 1 Like

Efficiently Transforming JDBC Query Results to JSON

Buffering query results introduces overhead and delay. Use the Pipe class provided by the Kilo framework to stream them instead!

June 4, 2024

by Greg Brown

· 2,485 Views · 1 Like

What Is Reverse ETL? Overview, Use Cases, and Key Benefits

Looking to go beyond traditional analytics? Reverse ETL is a nuanced process for businesses aiming to leverage data warehouses and other data platforms.

June 4, 2024

by Suhas Jangoan

· 6,255 Views · 2 Likes

New Ways for CNAPP to Shift Left and Shield Right: The Technology Trends That Will Allow CNAPP to Address More Extensive Threat Models

Because of the evolving threat landscape and complexity of modern organizations, the evolution of the CNAPP model yields both significant challenges and opportunities.

June 4, 2024

by Laurent Balmelli, PhD

· 4,078 Views · 1 Like

What Is ElastiCache Serverless?

This interview provides comprehensive answers about Amazon ElastiCache Serverless service, why it is needed, and when it is best to use it.

June 3, 2024

by Pavlo Konobeyev

· 3,998 Views · 2 Likes

Enhancing Vehicle Routing Problems With Deep Reinforcement Learning and Metaheuristics

Combining machine learning methods and traditional optimization techniques for logistics and fleet management execution optimizations.

June 3, 2024

by Sumit Mittal

· 4,870 Views · 2 Likes

Navigating the AI and Machine Learning Landscape: Insights From Indicium’s CDO

Indicium CDO Daniel Avancini shares insights on navigating the AI/ML landscape, from challenges and best practices to emerging trends.

June 3, 2024

by Tom Smith

CORE

· 2,375 Views · 1 Like

A Complete Guide To Implementing GraphQL for Java

This comprehensive guide is a valuable resource for Java developers seeking to create robust and efficient GraphQL API servers.

June 3, 2024

by David Ventimiglia

· 9,096 Views · 7 Likes

Hibernate Validator vs Regex vs Manual Validation: Which One Is Faster?

Inspired by coding for a performance backend competition, this article follows a test to find the fastest validator for Java applications.

June 3, 2024

by Fernando Boaglio

· 9,092 Views · 1 Like

High-Performance Storage Solutions

Pairing PostgreSQL with fast storage solutions is crucial for optimizing performance, minimizing downtime, and ensuring seamless data access.

June 3, 2024

by Sergey Platonov

· 2,608 Views · 3 Likes

An Overview of Data Pipeline Architecture

Dive into how a data pipeline helps process enormous amounts of data, key components, various architecture options, and best practices for maximum benefits.

Updated June 3, 2024

by Sreenath Devineni

CORE

· 16,891 Views · 5 Likes

Master the Art of Querying Data on Amazon S3

This article covers the importance of querying data stored on Amazon S3 and introduces three tools provided by AWS - Glue Crawler, Athena, and Redshift Spectrum.

June 3, 2024

by Satrajit Basu

CORE

· 5,509 Views · 2 Likes

The Impact of AI and Platform Engineering on Cloud Native's Evolution: Automate Your Cloud Journey to Light Speed

AI and platform engineering are emerging as revolutionary integrations for cloud-native environments, increasing scalability, reliability, and efficiency.

June 3, 2024

by Kellyn Gorman

CORE

· 5,918 Views · 1 Like

Introduction to Retrieval Augmented Generation (RAG)

RAG is a powerful AI approach that uses real-time data retrieval to provide accurate, contextually appropriate responses, aiding in the development of AI applications.

June 3, 2024

by Ravi Kumar Batchu

· 6,691 Views · 3 Likes

Observations on Cloud-Native Observability: A Journey From the Foundations of Observability to Surviving Its Challenges at Scale

Understand each team's responsibility, discover how to tackle observability challenges, and learn AI's role in the future of cloud-native observability.

June 2, 2024

by Eric D. Schabell

CORE

· 4,681 Views · 3 Likes

Elevating Defense Precision With AI-Powered Threat Triage in Proactive Dynamic Security

This article sheds light on how artificial intelligence and cybersecurity converge to revolutionize threat detection, incident response, and vulnerability management.

May 31, 2024

by Chinelo Okonkwo

· 3,450 Views · 3 Likes

Data sharing is the process of making data available to multiple users, applications, or organizations while maintaining its quality.

May 31, 2024

by Krishnamurty Raju Mudunuru

· 8,237 Views · 5 Likes

Optimal CX With Hidden Prompts: The Secret Sauce of Prompt Engineering for LLMs

One of the most effective yet often overlooked techniques in prompt engineering is the use of hidden prompts, also known as system prompts.

May 31, 2024

by Sapan Patel

· 2,835 Views · 1 Like

The Latest Data Engineering Topics