Data Engineering Resources

How to Fix the OWASP Top 10 Vulnerability in Angular 18.1.1v

Discuss the configurations and see examples of how to mitigate security vulnerabilities in an Angular web application 18.1.1v in detail.

August 1, 2024

by Kalyan Gottipati

· 7,819 Views · 1 Like

Leveraging Time Series Databases for Cutting-Edge Analytics: Specialized Software for Providing Timely Insights at Scale

Time series databases offer tools that simplify working with temporal data, enabling businesses to improve operational efficiency, predict failures, and enhance security.

August 1, 2024

by Ted Gooch

· 6,352 Views · 1 Like

Merge Multiple PDFs in MuleSoft

In this article, you will learn how to merge multiple PDFs and send back the merged PDF as a response using MuleSoft and Java.

July 31, 2024

by Anupam Nath

· 8,406 Views · 4 Likes

Ensuring Data Integrity Through Anomaly Detection: Essential Tools for Data Engineers

This article sets out to explore some of the essential tools required by organizations in the domain of data engineering to efficiently improve data quality.

July 31, 2024

by Keerthivasan santhanakrishnan

· 6,855 Views · 2 Likes

Interference in A/B Tests

While interference is a major problem affecting A/B tests, we can redesign the experiment software platform and create new statistical libraries to mitigate its effects.

July 31, 2024

by Saurabh Kumar

· 5,752 Views · 1 Like

SingleStore Kai Support for MongoDB $vectorSearch

SingleStore is a high-performance distributed SQL database. SingleStore Kai extends its compatibility to MongoDB's vector search capabilities. Learn more here.

July 31, 2024

by Akmal Chaudhri

CORE

· 2,811 Views · 1 Like

Plot Your REST Endpoints Using grafana-infinity-datasource

Plotting straight from the database is convenient, but is not always the case. Sometimes you might need something more complex that your API can support.

July 31, 2024

by Emmanouil Gkatziouras

CORE

· 6,463 Views · 2 Likes

Two-Tower Model for Fraud Detection: A Comprehensive Guide

Boost fraud detection with the two-tower model, a powerful architecture capturing complex relationships between transaction and user data.

July 31, 2024

by Gaurav Puri

· 4,953 Views · 3 Likes

Multimodal Search in AI Apps With PostgreSQL pgvector

This article demonstrates how you can add image and text-based search functionality to your AI applications using a multimodal LLM and PostgreSQL pgvector.

July 31, 2024

by Brett Hoyer

· 4,399 Views · 4 Likes

Outlier Identification in Continuous Data Streams With Z-Score and Modified Z-Score in a Moving Window

How do you spot outliers in continuous data streams? Learn to catch network performance hiccups effortlessly using z-score and modified z-score.

July 31, 2024

by Maksim Kupriianov

· 35,336 Views · 45 Likes

Automatic 1111: Adding Custom APIs

Following up on the last article that covered the fundamentals of Automatic 1111, let's take a look at the Options API and adding custom APIs.

July 31, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 4,845 Views · 7 Likes

Differentiating Rate Limits in Apache APISIX

Learn how to implement rate limiting with Apache APISIX: set the rate limit on a route, and move it to individual consumers and consumer groups.

July 31, 2024

by Nicolas Fränkel

· 3,941 Views · 2 Likes

Just Use PostgreSQL, a Quick-Start Guide: Exploring Essential and Extended Capabilities of the Most Beloved Database

Tour some of PostgreSQL's most notable capabilities and use cases, including various extensions for generative AI.

July 31, 2024

by Denis Magda

CORE

· 6,121 Views · 8 Likes

How to Generate Flame Graphs in Java

This article describes generating flame graphs in Java, discusses options, and in which use cases we could take advantage of it.

July 30, 2024

by Petr Bouda

CORE

· 10,340 Views · 7 Likes

GitOps: ArgoCD vs FluxCD

Discover the benefits of GitOps, explore a detailed comparison between ArgoCD and FluxCD, and learn how these tools streamline deployments and DevOps workflows.

July 30, 2024

by Unnati Mishra

· 7,838 Views · 4 Likes

How to Run Apache Spark on Kubernetes in Less Than 5 Minutes

Learn how to quickly set up and run Apache Spark on Kubernetes using Ilum for easier deployment, management, and scaling.

July 30, 2024

by Adam Lichtenstein

· 10,186 Views · 10 Likes

Implementing Multi-Level Caching in Java With NCache

Understanding the benefits of multi-level caching and setting up multi-level caching in Java using NCache — using it both as a distributed cache and a local cache.

July 30, 2024

by Abhinav Pandey

· 6,444 Views · 1 Like

Real-Time Anomaly Detection Using Large Language Models

Real-time anomaly detection using LLMs enhances accuracy for finance, healthcare, and cybersecurity through contextual analysis and pattern recognition.

July 30, 2024

by Harsh Daiya

CORE

· 12,472 Views · 3 Likes

Apache Iceberg Table Management

Apache Iceberg Table Management is essential to ensure smooth table operations by expiring/deleting unused data, metadata files.

July 30, 2024

by Rohit Kumar

· 3,223 Views · 1 Like

Enhancing Stream Data Processing With Snow Pipe, Cortex AI, and Snow Park

Customer sentiment analysis from reviews gathered from external source streams is ingested to Snowflake using Snow Pipe for further analysis using cortex AI API’s.

July 30, 2024

by Harshavardhan Yedla

· 3,658 Views · 3 Likes

The Latest Data Engineering Topics