Data Engineering Resources

Anomaly Detection: The Dark Horse of Fraud Detection

Anomaly detection, though less accurate, is a valuable tool for identifying unknown fraud patterns that the supervised models are not trained to detect.

August 26, 2024

by Sumit Makashir

· 4,422 Views · 2 Likes

Multi-Agent System’s Architecture

Multi-agent systems distribute decision-making across multiple agents, improving output through diverse perspectives and reducing bias.

August 26, 2024

by Mohammed Talib

· 5,905 Views · 1 Like

Better Search Results Through Intelligent Chunking and Metadata Integration

Chunking is an important, but underrated, aspect of LLM-based content retrieval, and effective management of It will yield world-class results.

August 26, 2024

by Pavan Vemuri

CORE

· 6,113 Views · 8 Likes

Efficient and Fault-Tolerant Solutions for Distributed Mutual Exclusion

Explore the tree quorum algorithm for mutual exclusion in distributed systems, its reduced communication overhead, fault tolerance, and more.

August 26, 2024

by Nakul Pandey

· 4,641 Views · 2 Likes

Securing the Future: Defending LLM-Based Applications in the Age of AI

Explore research on LLM-based application vulnerabilities and learn how to implement the OWASP Top 10 framework for enhanced AI security.

August 26, 2024

by Tom Smith

CORE

· 3,612 Views · 4 Likes

A Hands-On Guide to OpenTelemetry: Exploring Telemetry Data With Jaeger

This article continues the journey by learning how to effectively use visualized instrumentation telemetry data in Jaeger on your observability journey.

August 23, 2024

by Eric D. Schabell

CORE

· 5,757 Views · 3 Likes

Architectural Patterns for Enterprise Generative AI Apps: DSFT, RAG, RAFT, and GraphRAG

Explore the architectural patterns available to build GenAI solutions plus enterprise-level strategies to choose the right framework for the right use case.

August 23, 2024

by Suvoraj Biswas

· 7,154 Views · 2 Likes

The Role of Data Governance in Data Strategy: Part 3

Following our look into the enhancement of data in an org, explore Data Subject Access Rights (DSAR) and their correlation to individual rights in real-time.

August 23, 2024

by Satish Gaddipati

· 5,059 Views · 3 Likes

Integrating Apache Kafka in KRaft Mode With RisingWave for Event Stream Processing

Install and configure the latest version of Apache Kafka on a single-node cluster running on Ubuntu-22.04, and subsequently integrate it with RisingWave.

August 23, 2024

by Gautam Goswami

CORE

· 5,228 Views · 3 Likes

Parent Document Retrieval (PDR): Useful Technique in RAG

PDR allows RAG to respond accurately and nuanced to complex queries. Explore more in this step-by-step implementation using LangChain, OpenAI, and more.

August 22, 2024

by Intiaz Shaik

· 10,607 Views · 2 Likes

Setting Up CORS and Integration on AWS API Gateway Using CloudFormation

Learn about the significance of CORS, authorization including bearer tokens, and the advantages of selecting optional methods in place of standard GET requests.

August 22, 2024

by Vijay Panwar

CORE

· 8,245 Views · 2 Likes

Protect Your Alerts: The Importance of Independent Incident Alert Management

Hosting your incident alert management system separately from your primary cloud services is crucial for ensuring operational resilience.

August 22, 2024

by Judit Sharon

· 4,965 Views · 2 Likes

Kotlin Coroutines and OpenTelemetry Tracing

Explore the underlying workings of OpenTelemetry and analyze the workings of @WithSpan in general as well as within the context of Kotlin Coroutines.

August 22, 2024

by Nicolas Fränkel

· 7,739 Views · 5 Likes

Day in the Life of a Developer With Google’s Gemini Code Assist: Part 1

Explore Gemini Code Assist, its usage, and its impact beyond basic code generation for phases like bootstrapping, development, testing, deployment, and more.

August 22, 2024

by Aakash Sharma

· 9,015 Views · 7 Likes

Multicluster Gateways With Kubernetes Gateway API

In this article, discover how to use the Gateway API spec to configure gateways for multicluster setup.

August 22, 2024

by Ravi Verma

· 8,187 Views · 2 Likes

Evolution of Governance Framework With AI

Understand how a governance framework can improve productivity and increase the satisfaction of the stakeholders through AI.

August 22, 2024

by KARANVEER ANAND

· 3,948 Views · 2 Likes

Improving Snowflake Performance by Mastering the Query Profile

Take an in-depth look at how Snowflake executes queries and maximize Query performance using these advanced techniques.

August 21, 2024

by John Ryan

· 7,236 Views · 2 Likes

Automatic 1111: Sketch-to-Image Workflow

With Stable Diffusion Web UI Automatic 1111, create custom workflows for converting Sketches into photo-realistic images using diffusion and ControlNet models.

August 21, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 7,216 Views · 7 Likes

Data Pipeline Techniques in Action

Take a deep dive into the architectural concepts of data pipelines along with a hands-on tutorial for implementation, demonstrating the concepts in action.

August 21, 2024

by Sohil Shah

· 7,175 Views · 2 Likes

Using SQS With JMS for Legacy Applications

In this article, take an in-depth look at the steps to integrate a legacy Java application with SQS through JMS.

August 21, 2024

by Balaji Nagarajan

· 10,784 Views · 9 Likes

The Latest Data Engineering Topics