Data Engineering Resources

Impact of Generative AI in the Cellular and IoT Telecommunication

The telecommunications industry is on the brink of a transformative shift with the integration of Generative AI (Gen AI).

July 25, 2024

by BINU SUDHAKARAN PILLAI

· 1,974 Views · 1 Like

Developing Event-Driven, Auto-Compensating Saga Transactions For Microservices

Sagas are difficult to develop due to the complexity of compensation logic and lack of support for increasingly event-driven microservices. Find solutions here.

July 25, 2024

by Paul Parkinson

· 5,456 Views · 2 Likes

Pilot VPC and Advanced NAT: Securely Connect Overlapping Networks to AWS VPC

This article introduces a new method for creating secure connections between overlapping on-premise networks and Amazon VPC via a site-to-site VPN.

July 25, 2024

by Narinder Singh Kharbanda

· 3,409 Views · 2 Likes

Optimizing Search Precision With Self-Querying Retrieval (SQR) and Langchain

This tutorial describes the merits of SQR and how to use it with the Langchain library to improve retrieval precision and relevance within a RAG framework.

July 25, 2024

by Intiaz Shaik

· 4,705 Views · 2 Likes

Use Guardrails for Safeguarding Generative AI Applications Built Using Custom or Third-Party Models

Learn how the ApplyGuardrail API can provide a flexible way to integrate Guardrails with your generative AI applications.

July 24, 2024

by Abhishek Gupta

CORE

· 2,833 Views · 1 Like

Snowflake Integration Patterns: Apache Kafka vs. Zero ETL and Reverse ETL

Integration patterns for cloud-native Snowflake data warehouse: Batch data, Zero ETL, Reverse ETL, Real-time data ingestion with Apache Kafka.

July 24, 2024

by Kai Wähner

CORE

· 5,148 Views · 2 Likes

Democratizing Data With Graph RAG: What It Is, What It Can Do, How To Evaluate It

Graph RAG leverages the structured nature of knowledge graphs to organize data as nodes and relationships, enabling retrieval of relevant information.

July 24, 2024

by George Anadiotis

· 2,745 Views · 1 Like

Effortless API Mocking With Playwright

Automated testing of web applications often requires interaction with external APIs. However, relying on actual API responses can introduce variables beyond your control.

July 24, 2024

by Shivam Bharadwaj

· 4,588 Views · 2 Likes

The Hidden Costs of Lombok in Enterprise Java Solutions

Should enterprises consider Lombok a hero or a villain in disguise? Explore Lombok's benefits and potential drawbacks for enterprise Java solutions.

July 24, 2024

by Karina Varela

· 8,135 Views · 3 Likes

ChaosMeta for AI: Taking AI Stability to the Next Level With Chaos Engineering

Chaos engineering is about proactively exposing and addressing system vulnerabilities, greatly enhancing system resilience.

July 24, 2024

by Gerald Boersma

· 2,646 Views · 1 Like

Advanced URL Rewriting With Apache APISIX

Learn about using the proxy-rewrite plugin with a path variable in this post. You can reuse the same technique with multiple variables.

July 24, 2024

by Nicolas Fränkel

CORE

· 2,569 Views · 1 Like

Spring Microservice Tip: Abstracting the Database Hostname With Environment Variable

Secure database connection strings in Spring microservices using environment variables and placeholder expressions for the hostname using the properties file.

July 24, 2024

by Amol Gote

CORE

· 7,215 Views · 3 Likes

Consistency vs Availability: The Eternal Struggle in Distributed Databases

Since the CAP theorem dictates that systems can only guarantee two of the three properties, this article provides strategies to manage the trade-offs.

July 24, 2024

by Ajinkya Ghadge

· 3,742 Views · 7 Likes

Building a Modern Data Architecture: From Legacy Systems to Cloud Integration

This article will discuss the steps and considerations necessary for successfully transitioning from legacy systems to cloud-based solutions.

July 24, 2024

by Metin SARIKAYA

· 41,063 Views · 2 Likes

History and Future of LLMs

LLMs are marvels of modern technology, complex in their function, massive in size, and enable groundbreaking advancements. Explore their history and future.

July 23, 2024

by Kevin Vu

· 4,661 Views · 1 Like

Step-By-Step Guide To Setting up and Training GANs for Image Generation

Learn to set up and train Generative Adversarial Networks (GANs) using TensorFlow and PyTorch for image generation and manipulation.

July 23, 2024

by Neha Dhaliwal

· 3,178 Views · 2 Likes

Cross-Platform Integration: Enabling Seamless Workflow Between AI, Microservices, and Azure Cloud

Cross-platform integration of AI, microservices, and Azure Cloud is essential for businesses looking for innovative IT solutions.

July 23, 2024

by Nilesh Charankar

· 4,865 Views · 2 Likes

How To Migrate From Godaddy DNS to AWS Route 53

Start by setting up a new Hosted Zone in AWS, copying over existing DNS records, and updating Name Servers for faster propagation and enhanced management capabilities.

July 23, 2024

by Alfonso Valdes

· 3,211 Views · 2 Likes

JUnit 5 Custom TestListeners

Post your test execution results directly from CI/CD to your Test Management System via Zephyr API via JUnit5 Test Execution Listeners.

July 23, 2024

by Prathyusha Nama

· 4,682 Views · 3 Likes

Build End-To-End RAG Applications Using Airbyte and Snowflake Cortex

In this article, create a dedicated vector store directly within Snowflake — with no coding required — as the basis for AI applications.

July 23, 2024

by John Lafleur

· 2,347 Views · 1 Like

The Latest Data Engineering Topics