Data Engineering Resources

Beyond the Obvious: Uncovering the Hidden Challenges in Cybersecurity

Explore often-overlooked cybersecurity challenges, from the human element to AI risks, as revealed by industry experts at Black Hat 2024.

August 27, 2024

by Tom Smith

CORE

· 4,768 Views · 1 Like

Telemetry Pipelines Workshop: Integrating Fluent Bit With OpenTelemetry, Part 1

Take a look at integrating Fluent Bit with OpenTelemetry for use cases where this connectivity in your telemetry data infrastructure is essential.

August 27, 2024

by Eric D. Schabell

CORE

· 5,414 Views · 3 Likes

Debugging Low Cache Hit Ratio

Explore debug scenarios where we can’t utilize cached data and need to read from the physical drive, why it's important, what to look for, and helpful tools.

August 27, 2024

by Adam Furmanek

CORE

· 2,308 Views · 3 Likes

Maximizing Enterprise Data: Unleashing the Productive Power of AI With the Right Approach

Learn how organizations can unlock the full potential of their AI initiatives by considering critical elements such as infrastructure, cost, and more.

August 26, 2024

by Pan Singh Dhoni

· 4,685 Views · 1 Like

Methodcentipede

See an example of an antipattern that can lead to difficulties in maintaining and testing code and approaches that allow you to structure your work in a preventative way.

August 26, 2024

by Anton Belyaev

· 8,829 Views · 3 Likes

Anomaly Detection: The Dark Horse of Fraud Detection

Anomaly detection, though less accurate, is a valuable tool for identifying unknown fraud patterns that the supervised models are not trained to detect.

August 26, 2024

by Sumit Makashir

· 4,114 Views · 2 Likes

Multi-Agent System’s Architecture

Multi-agent systems distribute decision-making across multiple agents, improving output through diverse perspectives and reducing bias.

August 26, 2024

by Mohammed Talib

· 4,696 Views · 1 Like

Better Search Results Through Intelligent Chunking and Metadata Integration

Chunking is an important, but underrated, aspect of LLM-based content retrieval, and effective management of It will yield world-class results.

August 26, 2024

by Pavan Vemuri

· 4,666 Views · 4 Likes

Efficient and Fault-Tolerant Solutions for Distributed Mutual Exclusion

Explore the tree quorum algorithm for mutual exclusion in distributed systems, its reduced communication overhead, fault tolerance, and more.

August 26, 2024

by Nakul Pandey

· 3,857 Views · 2 Likes

Securing the Future: Defending LLM-Based Applications in the Age of AI

Explore research on LLM-based application vulnerabilities and learn how to implement the OWASP Top 10 framework for enhanced AI security.

August 26, 2024

by Tom Smith

CORE

· 2,736 Views · 1 Like

A Hands-On Guide to OpenTelemetry: Exploring Telemetry Data With Jaeger

This article continues the journey by learning how to effectively use visualized instrumentation telemetry data in Jaeger on your observability journey.

August 23, 2024

by Eric D. Schabell

CORE

· 5,203 Views · 2 Likes

Architectural Patterns for Enterprise Generative AI Apps: DSFT, RAG, RAFT, and GraphRAG

Explore the architectural patterns available to build GenAI solutions plus enterprise-level strategies to choose the right framework for the right use case.

August 23, 2024

by Suvoraj Biswas

· 5,691 Views · 2 Likes

The Role of Data Governance in Data Strategy: Part 3

Following our look into the enhancement of data in an org, explore Data Subject Access Rights (DSAR) and their correlation to individual rights in real-time.

August 23, 2024

by Satish Gaddipati

· 4,567 Views · 3 Likes

Integrating Apache Kafka in KRaft Mode With RisingWave for Event Stream Processing

Install and configure the latest version of Apache Kafka on a single-node cluster running on Ubuntu-22.04, and subsequently integrate it with RisingWave.

August 23, 2024

by Gautam Goswami

CORE

· 4,775 Views · 2 Likes

Parent Document Retrieval (PDR): Useful Technique in RAG

PDR allows RAG to respond accurately and nuanced to complex queries. Explore more in this step-by-step implementation using LangChain, OpenAI, and more.

August 22, 2024

by Intiaz Shaik

· 7,038 Views · 2 Likes

Setting Up CORS and Integration on AWS API Gateway Using CloudFormation

Learn about the significance of CORS, authorization including bearer tokens, and the advantages of selecting optional methods in place of standard GET requests.

August 22, 2024

by Vijay Panwar

CORE

· 7,127 Views · 2 Likes

Protect Your Alerts: The Importance of Independent Incident Alert Management

Hosting your incident alert management system separately from your primary cloud services is crucial for ensuring operational resilience.

August 22, 2024

by Judit Sharon

· 4,480 Views · 2 Likes

Kotlin Coroutines and OpenTelemetry Tracing

Explore the underlying workings of OpenTelemetry and analyze the workings of @WithSpan in general as well as within the context of Kotlin Coroutines.

August 22, 2024

by Nicolas Fränkel

CORE

· 7,285 Views · 5 Likes

Day in the Life of a Developer With Google’s Gemini Code Assist: Part 1

Explore Gemini Code Assist, its usage, and its impact beyond basic code generation for phases like bootstrapping, development, testing, deployment, and more.

August 22, 2024

by Aakash Sharma

· 8,136 Views · 6 Likes

Multicluster Gateways With Kubernetes Gateway API

In this article, discover how to use the Gateway API spec to configure gateways for multicluster setup.

August 22, 2024

by Ravi Verma

· 7,686 Views · 2 Likes

The Latest Data Engineering Topics