Data Engineering Resources

Understanding message brokers, and comparing different message brokers like SQS, Kinesis, Kafka, and Pulsar and the use cases they support.

May 6, 2024

by rahul goel

· 3,360 Views · 5 Likes

Explainable AI: Interpreting BERT Model

Learn how explainable AI techniques like Integrated Gradients can be used to make a deep learning NLP model interpretable.

May 6, 2024

by Sai Sharanya Nalla

· 3,524 Views · 5 Likes

Vector Databases for Generative AI Applications

This post details a recent talk from a session at GIDS 2024 and provides a deeper look into the fundamentals of vector databases for Generative AI applications.

May 6, 2024

by Abhishek Gupta

CORE

· 2,263 Views · 2 Likes

Cross-Cluster Replication for Read-Write Separation: Story of a Grocery Store Brand

Cross-cluster replication (CCR) in Apache Doris is proven to be fast, stable, and easy to use. It secures a real-time data synchronization latency of 1 second.

May 6, 2024

by Shirley H.

· 1,257 Views · 1 Like

Create Tweets With X API v2

Do you want to learn how to create Tweets from a Java application using the X (Twitter) API v2? This blog will show you in a step-by-step guide how to do so. Enjoy!

May 6, 2024

by Gunter Rotsaert

CORE

· 2,520 Views · 1 Like

Implementing EKS Multi-Tenancy Using Capsule (Part 3)

Understand how to configure namespace options, resource quotas, and limit ranges, network policies for the tenants. Verify cross-tenant and cross-cluster communications.

May 4, 2024

by Phani Krishna Kollapur Gandla

· 2,939 Views · 2 Likes

Implementing EKS Multi-Tenancy Using Capsule (Part 2)

Learn how to create single or multiple tenants on EKS cluster with single or multiple AWS IAM users as tenant owners using the Capsule framework.

May 3, 2024

by Phani Krishna Kollapur Gandla

· 1,754 Views · 1 Like

SQL Server From Zero To Advanced Level: Leveraging nProbe Data

Master SQL Server step-by-step, from basics to advanced techniques using nProbe data for enhanced network traffic analysis.

May 3, 2024

by Vijay Panwar

CORE

· 2,586 Views · 2 Likes

Flyway Database Migration From Spring Boot 3

Learn how to use Flyway for managing database migrations in the Spring Boot application. This example uses SpringBoot 3, MySQL8, and JPA.

May 3, 2024

by Nilanchala Panigrahy

· 2,183 Views · 6 Likes

Minhash LSH Implementation Walkthrough: Deduplication

MinHash Locality Sensitive Hashing (LSH) is a technique used for approximate nearest neighbor search in high-dimensional spaces.

May 3, 2024

by Rajat Toshniwal

· 3,923 Views · 2 Likes

Microsoft Reveals Phi-3: First in a New Wave of SLMs

Phi-3, Microsoft's innovative small language model, boosts efficiency, affordability, and performance with quicker deployment.

May 3, 2024

by Dileep Kumar Pandiya

· 2,974 Views · 1 Like

Securing the Generative AI Frontier: Specialized Tools and Frameworks for AI Firewall

In this article, you will learn about specialized tools and frameworks for prompt inspection and protection or AI firewalls.

May 3, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 2,842 Views · 4 Likes

Spring Microservice Application Resilience: The Role of @Transactional in Preventing Connection Leaks

Learn how @Transactional fixes connection leaks in Spring by managing database transactions, enhancing application stability and performance.

May 2, 2024

by Amol Gote

CORE

· 4,697 Views · 9 Likes

How Enabling Slow Query Log Enhances Postgres Observability

Here, learn about the slow query log in PostgreSQL, a feature that allows you to log queries that take longer than a specified threshold to execute.

May 2, 2024

by Adam Furmanek

CORE

· 1,930 Views · 1 Like

Preventing Account Takeover Through Open and Centralized Compromised Credential Index

Account Takeover frauds cause billions of dollars to people and companies. An open security standard could prevent this across software applications.

May 2, 2024

by Chetan Honnenahalli

· 1,436 Views · 2 Likes

Optimizing Azure DevOps Pipelines With AI and Continuous Integration

This article helps in leveraging AI to help detect issues, optimize workflows, and deliver high-quality software efficiently.

May 2, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 5,293 Views · 3 Likes

Dataframes With Big Data in Couchbase

In this article, we'll explore how users more comfortable with dataframes can work with their Big Data in Couchbase's Analytics Service.

May 2, 2024

by Glenn Galvizo

· 1,412 Views · 1 Like

How To Fix Kafka Consumers Due To Corrupted Log Files or Missing Log Files

This article explores recovering Kafka Brokers from corrupted data storage and recovering Kafka consumers due to missing log files.

May 2, 2024

by Ramu kakarla

· 2,920 Views · 1 Like

Understanding Gen AI: RAG Implementation

RAG is a technique to use existing LLMs to generate contextual responses with proprietary data, without the need to retrain the LLMs, offering a cost-effective solution.

May 2, 2024

by Ganesh Kumar Murugesan

· 2,412 Views · 2 Likes

Five Ways To Pass Parameters to Apache APISIX

This article explores all the ways to send parameters to Apache APISIX, which is beneficial when you write a custom plugin.

May 2, 2024

by Nicolas Fränkel

CORE

· 1,695 Views · 1 Like

The Latest Data Engineering Topics