Data Engineering Resources

Kumologica Container Inside AWS ECS Fargate

This tutorial shows the steps to build and run a simple hello world API using Kumologica and running it inside AWS ECS Fargate.

October 28, 2024

by Pranav K

CORE

· 6,762 Views · 2 Likes

How to Design Event Streams, Part 1

This article series addresses commonly asked questions, best practices, practical examples, and info on how to get started with event-driven architectures.

October 28, 2024

by Adam Bellemare

· 8,521 Views · 2 Likes

Using AUTHID Parameter in Oracle PL/SQL

In Oracle, the AUTHID clause is a powerful option to manage DB security and access control. Explore its different settings and how to use it effectively.

October 28, 2024

by Sachin More

· 10,675 Views · 2 Likes

AI-Driven Intent-Based Networking: The Future of Network Management Using AI

In this article, explore AI-driven intent-based networking (IBN) as a solution to manage increasingly complex networks.

October 28, 2024

by Aditi Godbole

· 7,056 Views · 5 Likes

The Power of Market Disruption: How to Detect Fraud With Graph Data

Market disruptors pave the way for innovation and break barriers once considered bulletproof. PuppyGraph uses market disruption and graph data to detect fraud.

October 28, 2024

by John Vester

CORE

· 60,341 Views · 3 Likes

12 Expert Tips for Secure Cloud Deployments

Explore essential strategies for securing cloud environments, focusing on IAM, encryption, automation, and proactive monitoring to mitigate cyber threats.

October 25, 2024

by Ralf Llanasas

· 7,898 Views · 5 Likes

Exploring Foundations of Large Language Models (LLMs): Tokenization and Embeddings

Learn more about tokenization and embeddings, which play a vital role in understanding human queries and converting knowledge bases to generate responses.

October 25, 2024

by MIHIR MEHTA

· 6,785 Views · 3 Likes

Reactive Kafka With Spring Boot

Learn how to build generic, easily configurable, testable reactive consumers, producers, and DLT with Kotlin, Spring Boot, WebFlux, and Testcontainers.

October 25, 2024

by Ion Pascari

· 17,966 Views · 16 Likes

Right-Sizing GPU and CPU Resources for Training and Inferencing Using Kubernetes

Learn how to harness advances in Kubernetes to optimize resource allocation by prioritizing workloads dynamically and efficiently based on need.

October 25, 2024

by Sanjay Basu PhD

· 8,312 Views · 2 Likes

Understanding the Differences Between Repository and Data Access Object (DAO)

DAO focuses on database operations (insert, update, delete), while Repository aligns with business logic in DDD. Learn the differences with a Java example.

October 24, 2024

by Otavio Santana

CORE

· 12,071 Views · 8 Likes

High-Speed Real-Time Streaming Data Processing

The article discusses the need for streaming data processing and evaluates available options. It explains that one size fits all is approach is not appropriate.

October 24, 2024

by Ashish Karalkar

· 11,080 Views · 3 Likes

Accelerating Connection Handshakes in Trusted Network Environments

Follow an overview of methods like TCP FastOpen, TLSv1.3, 0-RTT, and HTTP/3 to reduce handshake delays and improve server response times in secure environments.

October 24, 2024

by Maksim Kupriianov

· 19,629 Views · 20 Likes

Will GenAI Force Coders to Switch Careers?

Some suggest that devs may stop coding within 2 years as AI takes over coding tasks. Is this accurate? Will GenAI force coders to abandon their careers?

October 23, 2024

by Venu Moola

· 5,118 Views · 5 Likes

Automate Web Portal Deployment in Minutes Using GitHub Actions

Automating deployment is crucial for maintaining efficiency and reducing human error. Learn how to leverage GitHub Actions to deploy a feedback portal.

October 23, 2024

by Siddartha Paladugu

· 9,302 Views · 5 Likes

Data Architectures With Emphasis on Emerging Trends

This article gives you a thorough rundown of the newest data architectures, tools, and technologies with an emphasis on emerging trends.

October 23, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,754 Views · 4 Likes

Minimizing Latency in Kafka Streaming Applications That Use External API or Database Calls

Tired of latency slowing down your Kafka consumers? Learn how async operations, batching, and reactive frameworks like Spring WebFlux can help.

October 23, 2024

by Abhishek Goswami

· 4,822 Views · 4 Likes

Microservices Design Patterns: Essential Architecture and Design Guide

Learn about the design patterns of microservice software architecture to overcome challenges like loosely coupled services, defining databases, and more.

Updated October 23, 2024

by Rajesh Bhojwani

· 696,223 Views · 225 Likes

RAG Systems: A Brand New Architecture Tool

Discover how RAG systems boost AI by combining real-time data retrieval with language models for accurate, relevant responses.

October 23, 2024

by Pier-Jean MALANDRINO

CORE

· 5,911 Views · 5 Likes

Understanding Server Error (5XX) in Azure Services: A Deep Dive Into Azure Logic Apps

Encountering 5XX errors in Azure services? Read on to focus on how design challenges in workflows can lead to 5XX response codes and the steps to mitigate them.

October 23, 2024

by Shipra Nigam

· 3,953 Views · 2 Likes

Leveraging Event-Driven Data Mesh Architecture With AWS for Modern Data Challenges

Explore event-driven data mesh architecture, and how when combined with AWS, it becomes a robust solution for addressing complex data management challenges.

October 23, 2024

by Sunil Pradhan Sharma

· 8,711 Views · 12 Likes

The Latest Data Engineering Topics