Data Engineering Resources

Wireshark and tcpdump: A Debugging Power Couple

Explore the power of Wireshark and tcpdump for network analysis in our comprehensive guide, unveiling tips for effective troubleshooting.

April 17, 2024

by Shai Almog

CORE

· 2,917 Views · 4 Likes

3 Ways Blockchain Reinforces Data Integrity in the Cloud

Companies must maintain data reliability to ensure informational accuracy and security, especially in cloud-first approaches. How can blockchain keep things secure?

April 17, 2024

by Emily Newton

· 2,486 Views · 1 Like

Explainable AI: Interpreting Complex AI/ML Models

This article explores Explainable AI (XAI), focusing on making AI systems' decisions transparent and understandable through techniques like LIME and SHAP.

April 16, 2024

by Rajiv Avacharmal

· 963 Views · 2 Likes

Preventing Advanced Persistent Threats in Kubernetes

Find the balance between convenience, operational efficiency, and the rising threats of Advanced Persistent Threats (APTs) in the world of ephemeral containers.

April 16, 2024

by Nigel Douglas

· 1,129 Views · 2 Likes

Essential Math to Master AI and Quantum

Learn the essential subset of mathematical concepts to understand the underpinnings of artificial intelligence and quantum computing.

April 16, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 3,169 Views · 10 Likes

IP Geolocation Myths and Facts

Debunking IP geolocation myths helps developers create secure apps and users make informed privacy choices.

April 15, 2024

by camimi Morales

· 1,317 Views · 1 Like

Vector Databases: Unlocking New Dimensions in Video Streaming

Explore how vector embeddings and machine learning transform search capabilities in streaming platforms and enhance user discovery and personalization.

April 15, 2024

by Sai Mahesh vuppalapati

· 3,584 Views · 6 Likes

Strategic Deployments in AWS: Leveraging IaC for Cross-Account Efficiency

This article provides a step-by-step strategy to streamline Docker deployments on AWS ECS with secure, multi-account CloudFormation.

April 15, 2024

by Prachi Tembhekar

· 1,846 Views · 3 Likes

Real-Time Data Transfer from Apache Flink to Kafka to Druid for Analysis/Decision-Making

In this article, follow an outline of the steps to transfer processed data from Flink 1.18.1 to a Kafka 2.13-3.7.0 topic.

April 15, 2024

by Gautam Goswami

CORE

· 2,146 Views · 2 Likes

Implementing the Idempotency-Key Specification on Apache APISIX

Learn how to implement Idempotency-Key header with Apache APISIX and Redis for reliable APIs without duplicates.

April 13, 2024

by Nicolas Fränkel

CORE

· 2,406 Views · 1 Like

Modern Microservices, Part 5: Persistence and Packaging

In this guide, learn about adding persistence to our microservice powered by Postgres and package it for easy distribution via Docker Compose.

April 13, 2024

by Amardeep Singh

· 4,261 Views · 5 Likes

Analyze and Debug Quarkus-Based AWS Lambda Functions With X-Ray

Use Quarkus and AWS X-Ray with Jakarta CDI Interceptors to keep your code clean.

April 13, 2024

by Jeroen Reijn

CORE

· 3,329 Views · 2 Likes

Visualizing Software Architecture With the C4 Model and Structurizr

Explore the C4 model and Structurizr and see how they can be used to visualize and manage software architecture effectively with practical examples and insights.

April 12, 2024

by Gunter Rotsaert

CORE

· 1,701 Views · 1 Like

Using Spring AI With AI/LLMs to Query Relational Databases

Explore how the AIDocumentLibraryChat project has been extended to support questions for searching relational databases.

April 12, 2024

by Sven Loesekann

· 2,903 Views · 4 Likes

Firewall Basic Bypassing Techniques With Nmap and Hping3

Learn more about basic firewall bypassing techniques with Nmap and hping3.

Updated April 12, 2024

by Uladzislau Murashka

· 93,827 Views · 8 Likes

DevOps vs SRE vs Platform Engineer vs Cloud Roles Explained

In this article, I offer my thoughts but recognize there's a great deal of room for interpretation for understanding the differences between these terms.

Updated April 12, 2024

by Amit Eyal Govrin

· 14,611 Views · 5 Likes

Building CI/CD Pipelines for Java Using Azure DevOps

Visual Studio Team Services has become Azure DevOps. Java devs can learn how to build a release automation pipeline for their web applications.

Updated April 11, 2024

by Ruth Yakubu

· 44,854 Views · 5 Likes

Fixing Duplicate API Requests

The first rule of distributed systems is: "Don’t distribute your system." Designing distributed systems correctly is infamously hard for multiple reasons.

April 11, 2024

by Nicolas Fränkel

CORE

· 1,688 Views · 1 Like

Instant APIs With Copilot and API Logic Server

Describe a database to Copilot, and create a running API and Admin App in moments. Or, use an existing database. Customize in your IDE with Rules and Python.

April 11, 2024

by Val Huber

CORE

· 3,000 Views · 10 Likes

Prompt Engineering vs Fine-Tuning vs RAG

Explore the pros and cons of prompt engineering, fine-tuning, and RAG to help you understand when and how to use these techniques effectively.

April 11, 2024

by Usama Jamil

· 1,693 Views · 4 Likes

The Latest Data Engineering Topics