Data Engineering Resources

Guarding Privacy: Cutting-Edge Technologies for Data Protection

Discover how advanced technologies are revolutionizing data security. Learn about encryption, blockchain, and machine learning in the fight against cyber threats.

July 29, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,467 Views · 2 Likes

Automating Databases for Modern DevOps Practices: A Guide to Common Patterns and Anti-Patterns for Database Automation Techniques

By embracing AI, automation, database DevOps, and other emerging trends, organizations can ensure robust, efficient, and future-proofed database management practices.

July 29, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 7,535 Views · 9 Likes

Application-Level Tracing: The Good, the Bad, and the Alternative

Traditional app-level tracing was good up until a certain level. For complex troubleshooting, live debugging is taking the first seat in modern observability.

July 29, 2024

by Eran Kinsbruner

· 2,731 Views · 4 Likes

Implementing and Deploying a Real-Time AI-Powered Chatbot With Serverless Architecture

Build a real-time AI chatbot using AWS Lambda for the backend and a simple HTML/JavaScript frontend.

July 29, 2024

by Neha Dhaliwal

· 4,778 Views · 3 Likes

Enhancing Query Performance With AI and Vector Search in Azure Cosmos DB for PostgreSQL

Learn to enhance query performance using AI and vector search in Azure Cosmos DB for PostgreSQL, boosting data retrieval efficiency and accuracy.

July 29, 2024

by Sameer Danave

· 2,177 Views · 2 Likes

Why OOP Is a Bad Fit for Custom Software

Everything in programming is a trade-off. The combination of imperative and (DO)RY is the best one that results in more total code, but more maintainable code.

July 29, 2024

by Greg Hall

· 7,740 Views · 2 Likes

DB2 vs. Oracle for IBM Maximo: A Comparative Analysis

This essay explores the differences between DB2 and Oracle in the context of their integration with IBM Maximo and specific features that benefit Maximo environments.

July 28, 2024

by Lakshmana Rao Koppada

· 3,370 Views · 1 Like

Real-Time Streaming Architectures: A Technical Deep Dive Into Kafka, Flink, and Pinot

While individual components like Kafka, Flink, and Pinot are very powerful, managing them at scale across cloud and on-premises deployments can be operationally complex.

July 28, 2024

by Abhishek Gupta

CORE

· 10,570 Views · 4 Likes

Practitioner’s Guide to Deep Learning

An overview of best practices, recommendations, and fundamentals for managing a deep learning project to ensure a robust AI product.

July 26, 2024

by Anurag Paul

· 5,221 Views · 7 Likes

Introduction to Polymorphism With Database Engines in NoSQL Using Jakarta NoSQL

This tutorial covers setting up Helidon with Oracle NoSQL, defining polymorphic entities, and managing JSON data efficiently.

July 26, 2024

by Otavio Santana

CORE

· 5,956 Views · 1 Like

How to Secure Your Angular Apps: End-to-End Encryption of API Calls

Explore an example of implementing end-to-end encryption of API calls in your secure web app built with Angular.

July 26, 2024

by Kalyan Gottipati

· 11,655 Views · 3 Likes

How To Implement a Gateway With Spring Cloud

Learn how to implement a gateway component for a microservice system with the Spring Cloud Gateway package.

July 25, 2024

by Mario Casari

· 10,162 Views · 2 Likes

Exploring the Evolution of Transformers: From Basic To Advanced Architectures

This blog traces the evolution of Transformers from the original model to advanced architectures, highlighting significant advancements.

July 25, 2024

by Suri (thammuio)

CORE

· 22,656 Views · 3 Likes

Impact of Generative AI in the Cellular and IoT Telecommunication

The telecommunications industry is on the brink of a transformative shift with the integration of Generative AI (Gen AI).

July 25, 2024

by BINU SUDHAKARAN PILLAI

· 18,561 Views · 4 Likes

Developing Event-Driven, Auto-Compensating Saga Transactions For Microservices

Sagas are difficult to develop due to the complexity of compensation logic and lack of support for increasingly event-driven microservices. Find solutions here.

July 25, 2024

by Paul Parkinson

· 7,412 Views · 2 Likes

Pilot VPC and Advanced NAT: Securely Connect Overlapping Networks to AWS VPC

This article introduces a new method for creating secure connections between overlapping on-premise networks and Amazon VPC via a site-to-site VPN.

July 25, 2024

by Narinder Singh Kharbanda

· 5,516 Views · 3 Likes

Optimizing Search Precision With Self-Querying Retrieval (SQR) and Langchain

This tutorial describes the merits of SQR and how to use it with the Langchain library to improve retrieval precision and relevance within a RAG framework.

July 25, 2024

by Intiaz Shaik

· 5,860 Views · 2 Likes

Use Guardrails for Safeguarding Generative AI Applications Built Using Custom or Third-Party Models

Learn how the ApplyGuardrail API can provide a flexible way to integrate Guardrails with your generative AI applications.

July 24, 2024

by Abhishek Gupta

CORE

· 3,704 Views · 1 Like

Snowflake Integration Patterns: Apache Kafka vs. Zero ETL and Reverse ETL

Integration patterns for cloud-native Snowflake data warehouse: Batch data, Zero ETL, Reverse ETL, Real-time data ingestion with Apache Kafka.

July 24, 2024

by Kai Wähner

CORE

· 6,593 Views · 2 Likes

Democratizing Data With Graph RAG: What It Is, What It Can Do, How To Evaluate It

Graph RAG leverages the structured nature of knowledge graphs to organize data as nodes and relationships, enabling retrieval of relevant information.

July 24, 2024

by George Anadiotis

· 3,257 Views · 1 Like

The Latest Data Engineering Topics