Data Engineering Resources

Learn how to build generic, easily configurable, testable reactive consumers, producers, and DLT with Kotlin, Spring Boot, WebFlux, and Testcontainers.

October 25, 2024

by Ion Pascari

· 17,648 Views · 14 Likes

Right-Sizing GPU and CPU Resources for Training and Inferencing Using Kubernetes

Learn how to harness advances in Kubernetes to optimize resource allocation by prioritizing workloads dynamically and efficiently based on need.

October 25, 2024

by Sanjay Basu PhD

· 8,164 Views · 2 Likes

Understanding the Differences Between Repository and Data Access Object (DAO)

DAO focuses on database operations (insert, update, delete), while Repository aligns with business logic in DDD. Learn the differences with a Java example.

October 24, 2024

by Otavio Santana

CORE

· 11,370 Views · 8 Likes

High-Speed Real-Time Streaming Data Processing

The article discusses the need for streaming data processing and evaluates available options. It explains that one size fits all is approach is not appropriate.

October 24, 2024

by Ashish Karalkar

· 10,888 Views · 3 Likes

Accelerating Connection Handshakes in Trusted Network Environments

Follow an overview of methods like TCP FastOpen, TLSv1.3, 0-RTT, and HTTP/3 to reduce handshake delays and improve server response times in secure environments.

October 24, 2024

by Maksim Kupriianov

· 19,184 Views · 20 Likes

Will GenAI Force Coders to Switch Careers?

Some suggest that devs may stop coding within 2 years as AI takes over coding tasks. Is this accurate? Will GenAI force coders to abandon their careers?

October 23, 2024

by Venu Moola

· 4,950 Views · 5 Likes

Automate Web Portal Deployment in Minutes Using GitHub Actions

Automating deployment is crucial for maintaining efficiency and reducing human error. Learn how to leverage GitHub Actions to deploy a feedback portal.

October 23, 2024

by Siddartha Paladugu

· 9,170 Views · 5 Likes

Data Architectures With Emphasis on Emerging Trends

This article gives you a thorough rundown of the newest data architectures, tools, and technologies with an emphasis on emerging trends.

October 23, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,629 Views · 4 Likes

Minimizing Latency in Kafka Streaming Applications That Use External API or Database Calls

Tired of latency slowing down your Kafka consumers? Learn how async operations, batching, and reactive frameworks like Spring WebFlux can help.

October 23, 2024

by Abhishek Goswami

· 4,653 Views · 4 Likes

Microservices Design Patterns: Essential Architecture and Design Guide

Learn about the design patterns of microservice software architecture to overcome challenges like loosely coupled services, defining databases, and more.

Updated October 23, 2024

by Rajesh Bhojwani

· 694,210 Views · 225 Likes

RAG Systems: A Brand New Architecture Tool

Discover how RAG systems boost AI by combining real-time data retrieval with language models for accurate, relevant responses.

October 23, 2024

by Pier-Jean MALANDRINO

CORE

· 5,736 Views · 5 Likes

Understanding Server Error (5XX) in Azure Services: A Deep Dive Into Azure Logic Apps

Encountering 5XX errors in Azure services? Read on to focus on how design challenges in workflows can lead to 5XX response codes and the steps to mitigate them.

October 23, 2024

by Shipra Nigam

· 3,803 Views · 2 Likes

Leveraging Event-Driven Data Mesh Architecture With AWS for Modern Data Challenges

Explore event-driven data mesh architecture, and how when combined with AWS, it becomes a robust solution for addressing complex data management challenges.

October 23, 2024

by Sunil Pradhan Sharma

· 8,513 Views · 12 Likes

Building Predictive Analytics for Loan Approvals

Here, explore various techniques for loan approvals, using models like Logistic Regression and BERT, and applying SHAP and LIME for model interpretation.

October 23, 2024

by Akmal Chaudhri

CORE

· 5,172 Views · 3 Likes

How to Use Retrieval-Augmented Generation (RAG) Locally

This article explores how to use Retrieval-Augmented Generation (RAG) for building more effective and engaging conversational AI applications.

October 22, 2024

by Shamim Bhuiyan

· 6,071 Views · 2 Likes

Implement Hibernate Second-Level Cache With NCache

Set up a Java application with Hibernate, configure NCache as the second-level cache, and test the implementation to see how caching reduces the DB load.

October 22, 2024

by Abhinav Pandey

· 8,247 Views · 3 Likes

Calling a Client Via Spring @schedule Cron Job

In this article, a cron job will be set up that will run parametrically in a certain period using Spring's scheduling feature.

October 22, 2024

by Erkin Karanlık

· 4,852 Views · 2 Likes

PHP Opcode: Improve Application Performance Without Changing Your Code

Learn how little syntax tips can automatically optimize the PHP code execution performance without the need of complex refactoring.

October 22, 2024

by Valerio Barbera

· 5,207 Views · 1 Like

Symbolic and Connectionist Approaches: A Journey Between Logic, Cognition, and the Future Challenges of AI

Explore the strengths and limitations of symbolic and connectionist AI as well as the challenges AI faces in replicating human experience and reasoning.

October 22, 2024

by Frederic Jacquet

CORE

· 4,254 Views · 1 Like

AI/ML Innovation in the Kubernetes Ecosystem

Recent innovations like the Model Registry, ModelCars feature, and TrustyAI are delivering manageability, speed, and accountability for AI/ML workloads

October 22, 2024

by Yuan Tang

· 6,236 Views · 5 Likes

The Latest Data Engineering Topics