Data Engineering Resources

Deploy an AWS Lambda Function Using Amazon Q

Amazon Q is a generative AI-powered assistant. No browser tabs were used to get this done (except when searching for funny pics for this blog).

May 7, 2024

by Abhishek Gupta

CORE

· 2,437 Views · 1 Like

Understanding the Application and Impact of AI in Software Development Life Cycle

Explore AI's role in enhancing software development with automation, smarter decisions, and efficiency, leading to the rapid creation of high-quality software.

May 6, 2024

by Shantanu Kumar

CORE

· 11,783 Views · 9 Likes

How To Use LLMs: Summarize Long Documents

This article gives a step-by-step solution to summarizing really long documents using Generative AI and Large Language Models.

May 6, 2024

by Roger Oriol

· 1,669 Views · 2 Likes

Implementing EKS Multi-Tenancy Using Capsule (Part 4)

Take a deep dive into security policy verification use cases by configuring security policy engines like Kyverno or Open Gatekeeper.

May 6, 2024

by Phani Krishna Kollapur Gandla

· 2,422 Views · 2 Likes

Evaluating Message Brokers

Understanding message brokers, and comparing different message brokers like SQS, Kinesis, Kafka, and Pulsar and the use cases they support.

May 6, 2024

by rahul goel

· 4,279 Views · 6 Likes

Explainable AI: Interpreting BERT Model

Learn how explainable AI techniques like Integrated Gradients can be used to make a deep learning NLP model interpretable.

May 6, 2024

by Sai Sharanya Nalla

· 3,784 Views · 5 Likes

Vector Databases for Generative AI Applications

This post details a recent talk from a session at GIDS 2024 and provides a deeper look into the fundamentals of vector databases for Generative AI applications.

May 6, 2024

by Abhishek Gupta

CORE

· 2,934 Views · 2 Likes

Cross-Cluster Replication for Read-Write Separation: Story of a Grocery Store Brand

Cross-cluster replication (CCR) in Apache Doris is proven to be fast, stable, and easy to use. It secures a real-time data synchronization latency of 1 second.

May 6, 2024

by Shirley H.

· 1,575 Views · 1 Like

Create Tweets With X API v2

Do you want to learn how to create Tweets from a Java application using the X (Twitter) API v2? This blog will show you in a step-by-step guide how to do so. Enjoy!

May 6, 2024

by Gunter Rotsaert

CORE

· 3,027 Views · 1 Like

Implementing EKS Multi-Tenancy Using Capsule (Part 3)

Understand how to configure namespace options, resource quotas, and limit ranges, network policies for the tenants. Verify cross-tenant and cross-cluster communications.

May 4, 2024

by Phani Krishna Kollapur Gandla

· 3,809 Views · 2 Likes

Implementing EKS Multi-Tenancy Using Capsule (Part 2)

Learn how to create single or multiple tenants on EKS cluster with single or multiple AWS IAM users as tenant owners using the Capsule framework.

May 3, 2024

by Phani Krishna Kollapur Gandla

· 2,369 Views · 1 Like

SQL Server From Zero To Advanced Level: Leveraging nProbe Data

Master SQL Server step-by-step, from basics to advanced techniques using nProbe data for enhanced network traffic analysis.

May 3, 2024

by Vijay Panwar

CORE

· 3,605 Views · 2 Likes

Flyway Database Migration From Spring Boot 3

Learn how to use Flyway for managing database migrations in the Spring Boot application. This example uses SpringBoot 3, MySQL8, and JPA.

May 3, 2024

by Nilanchala Panigrahy

· 2,478 Views · 6 Likes

Minhash LSH Implementation Walkthrough: Deduplication

MinHash Locality Sensitive Hashing (LSH) is a technique used for approximate nearest neighbor search in high-dimensional spaces.

May 3, 2024

by Rajat Toshniwal

· 8,419 Views · 2 Likes

Microsoft Reveals Phi-3: First in a New Wave of SLMs

Phi-3, Microsoft's innovative small language model, boosts efficiency, affordability, and performance with quicker deployment.

May 3, 2024

by Dileep Kumar Pandiya

· 3,569 Views · 1 Like

Securing the Generative AI Frontier: Specialized Tools and Frameworks for AI Firewall

In this article, you will learn about specialized tools and frameworks for prompt inspection and protection or AI firewalls.

May 3, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 3,742 Views · 4 Likes

Spring Microservice Application Resilience: The Role of @Transactional in Preventing Connection Leaks

Learn how @Transactional fixes connection leaks in Spring by managing database transactions, enhancing application stability and performance.

May 2, 2024

by Amol Gote

CORE

· 5,990 Views · 9 Likes

How Enabling Slow Query Log Enhances Postgres Observability

Here, learn about the slow query log in PostgreSQL, a feature that allows you to log queries that take longer than a specified threshold to execute.

May 2, 2024

by Adam Furmanek

CORE

· 2,801 Views · 2 Likes

Preventing Account Takeover Through Open and Centralized Compromised Credential Index

Account Takeover frauds cause billions of dollars to people and companies. An open security standard could prevent this across software applications.

May 2, 2024

by Chetan Honnenahalli

· 1,780 Views · 2 Likes

Optimizing Azure DevOps Pipelines With AI and Continuous Integration

This article helps in leveraging AI to help detect issues, optimize workflows, and deliver high-quality software efficiently.

May 2, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 7,318 Views · 3 Likes

The Latest Data Engineering Topics