Data Engineering Resources

After a year, I finally converted all examples from the book Refactoring to Patterns by Joshua Kerievsky to Python. I explain some examples in this article.

January 23, 2025

by Douglas Cardoso

· 2,586 Views

Multi-Tenant Data Isolation and Row Level Security

Learn how Row Level Security (RLS) enforces data isolation in multi-tenant SaaS systems with a shared database model to improve security and reduce errors.

January 23, 2025

by Rajind Ruparathna

· 10,886 Views

What OpenAI's Reasoning Models Mean for GPT and AI

OpenAI’s reasoning models hint at a future where AI goes beyond generating content to truly understanding and solving complex problems.

January 23, 2025

by Mandeep Kaur

· 3,663 Views · 2 Likes

Building an AI-Powered Cold Email System With CrewAI

Learn how to build a CrewAI-powered system for automating cold email outreach. Explore AI agents, YAML configuration, and real-world software integration.

January 23, 2025

by Aditya Karnam Gururaj Rao

· 4,575 Views · 3 Likes

Mocking and Its Importance in Integration and E2E Testing

Learn about mocking, its role in integration and E2E testing, and how to mock an API effectively using tools like WireMock for reliable results.

January 23, 2025

by Dhanunjay Reddy Seelam

· 6,122 Views · 4 Likes

An Introduction to Bloom Filters

An introduction to the Bloom filter data structure, explaining what it is, when to use it, and key technical details about its implementation and functionality.

January 23, 2025

by Sandeep Kumar Gond

· 2,819 Views · 3 Likes

Powering LLMs With Apache Camel and LangChain4j

Learn how to use Apache Camel with LangChain4j to provide LLMs with the ability to call tools, enhancing your integration workflows.

January 23, 2025

by Miguel Delgadillo

· 5,124 Views · 3 Likes

Understanding HyperLogLog for Estimating Cardinality

Learn about the probabilistic algorithm designed to estimate the cardinality of a dataset with both high accuracy and low memory usage.

January 23, 2025

by Bhala Ranganathan

CORE

· 5,525 Views · 2 Likes

Fresh Data for AI With Spring AI Function Calls

Learn to integrate AI function calls using Spring AI for APIs like OpenLibrary, with JSON and text responses, and display results in Angular Material Tree.

January 22, 2025

by Sven Loesekann

· 5,887 Views · 5 Likes

Context Is King: How LLMs Are Going to Change Code Generation in Modern IDEs

Your AI code completion tools that just don’t grasp your project? Today’s modern IDEs are integrating advanced LLMs that truly comprehend your codebase.

January 22, 2025

by balaji thadagam kandavel

· 6,248 Views · 2 Likes

Enhancing System Resilience: Effective Caching Strategies for Distributed Systems

Caching boosts performance in distributed systems but can fail. Mitigate risks with intermediate caches and smart caching strategies. Always design for cache failure.

January 22, 2025

by Rajesh Kumar Pandey

· 4,808 Views · 3 Likes

Serverless AI Inference

Serverless platforms abstract out the complexities involved in the deployment of machine learning models, handle compute demand and help reduce infrastructure costs.

January 22, 2025

by Bhala Ranganathan

CORE

· 6,949 Views · 2 Likes

Hybrid Search Using Postgres DB

This article explains how to implement hybrid search (lexical and semantic) in a single PostgresDB using full-text-search and pgvector.

January 22, 2025

by Suraj Dharmapuram

· 7,006 Views · 6 Likes

Automate Serverless Deployments With Ansible and OCI

In this article, learn to automate serverless deployments with Ansible and OCI Functions to simplify workflows, scale apps, and reduce operational complexities.

January 22, 2025

by Binoj Melath Nalinakshan Nair

CORE

· 4,138 Views · 8 Likes

Build Your Own GitHub-Like Tool With React in One Hour

Learn how to build a GitHub-like web app using React and SCSS in just one hour with features, code structure, API integration, and setup steps to get you started quickly.

January 21, 2025

by Maulik Suchak

· 6,715 Views · 1 Like

5 Key Steps for a Successful Cloud Migration Strategy

Applying the right strategy is essential when moving a company from on-premises to the cloud or from one cloud to another.

January 21, 2025

by Srinivas Chippagiri

CORE

· 18,613 Views · 1 Like

Choose a Database With Hybrid Vector Search for AI Apps

Semantic and traditional search capabilities are needed for AI applications. In this article, we look at the features that LLM/RAG applications need to succeed.

January 21, 2025

by John Lafleur

· 3,379 Views · 2 Likes

Azure Web Apps: Seamless Deployments With Deployment Slots

This article will show you how to swap deployment slots to deploy a tested app to production and roll back to a previous version when unexpected issues arise.

January 21, 2025

by Sanjeev Kumar

· 6,373 Views · 3 Likes

Structured Logging in Spring Boot 3.4 for Improved Logs

Comparison of structured logging with traditional logging, its uses, and advancements in Spring Framework 6.2 and Spring Boot 3.4.

January 21, 2025

by Karthik Kamarapu

· 7,559 Views · 6 Likes

OPC-UA and MQTT: A Guide to Protocols, Python Implementations

Explore two essential IoT protocols: OPC-UA for secure and structured industrial device communication and MQTT, a lightweight, real-time protocol for telemetry.

January 21, 2025

by Nikhil Makhija

· 5,818 Views · 2 Likes

The Latest Data Engineering Topics