Data Engineering Resources

Producing Messages at Warp Speed: Best Practices for Optimizing Your Producers

This article provides insights into the best practices for optimizing your message producer for maximum message throughput.

October 26, 2023

by RJ Nowling

· 2,905 Views · 1 Like

Simplifying Integration and Automation: Boomi CTO Shares Vision for Developers

Democratized and governed integration platforms, harnessing AI and automation to simplify complex tasks and drive continuous evolution.

October 26, 2023

by Tom Smith

CORE

· 3,941 Views · 1 Like

Transaction Isolation Levels For The Highest Possible Performance

Database transaction isolation levels let us get even better performance without rewriting our applications. See how they can be helpful and why we should care.

October 26, 2023

by Adam Furmanek

CORE

· 3,855 Views · 6 Likes

Architecture Decision Records

An Architecture Decision Record (ADR) is an important design document that is written to capture a decision, the decision context, and its consequences.

October 26, 2023

by Rakesh Rao

· 10,448 Views · 16 Likes

IoT Connectivity Explored: A Deep Dive Into Predominant Communication Standards

This article offers a comprehensive overview of major IoT communication protocols, detailing their purposes, primary use cases, and key technical specifications.

October 26, 2023

by Manvendra Sharma

· 4,961 Views · 2 Likes

Python “Magic” Methods (Part 2)

Let's continue our exploration of Python's magic methods in this second part of the series. This part will focus on numbers and containers, i.e., collections.

October 26, 2023

by Nicolas Fränkel

· 6,294 Views · 10 Likes

Boomi CEO Outlines Vision for Integration and Automation Platform

AI-powered platform overcomes digital fragmentation and empowers developers, enabling companies to realize business value from their data more quickly.

October 26, 2023

by Tom Smith

CORE

· 3,837 Views · 1 Like

Kafka Multi-Cluster Deployment on Kubernetes: Simplified!

Brief overview of Apache Kafka and common use cases, current tools to scale multi-cluster deployments, and connectivity solutions to simplify multi-cluster deployments.

October 26, 2023

by Ray Edwards

· 6,800 Views · 3 Likes

Dual Pillars of Embedded Systems: Ensuring Safety and Security

Embedded systems are everywhere, facing various threats. Balancing safety (flawless operation) and security (protection from breaches) is vital.

October 26, 2023

by Manvendra Sharma

· 4,634 Views · 2 Likes

Generative AI Apps With Amazon Bedrock: Getting Started for Go Developers

Use the AWS Go SDK and Amazon Bedrock Foundation Models (FMs) for tasks such as content generation, building chat applications, and handling streaming data.

October 25, 2023

by Abhishek Gupta

CORE

· 9,098 Views · 3 Likes

How To Avoid AI Hallucinations With ChatGPT

AI Hallucinations are often mentioned in the context of ChatGPT. This article describes how to 100% perfectly eliminate AI Hallucinations.

October 25, 2023

by Thomas Hansen

CORE

· 3,524 Views · 2 Likes

OpenTelemetry for Microservices Tracing and Observability

Learn what OpenTelemetry is and how it supports vendor neutrality for DevOps and SREs to monitor and observe microservices in the cloud.

October 25, 2023

by Anas T

· 7,340 Views · 9 Likes

Benefits and Limitations of Diffusion Models

Diffusion models advance generative AI through remarkably realistic imagery, but limitations exist around compute needs and ethics. Discover their capabilities and challenges.

October 25, 2023

by Hiren Dhaduk

· 4,917 Views · 1 Like

What To Expect From Retrievel-Augmented Generation and Self-Hosted LLMs

In this article, you will learn how to develop AI applications using self-hosted LLMs in combination with RAG techniques.

October 25, 2023

by Fangrui Liu

· 2,287 Views · 1 Like

Secure Schema Migrations With Flyway and CockroachDB Dedicated

In this article, explore a solution to TLS certificate issues and containerized schema migrations with Flyway and CockroachDB.

October 25, 2023

by Artem Ervits

CORE

· 3,227 Views · 3 Likes

The Outbox Pattern

Learn how the outbox pattern ensures reliable message delivery across distributed systems, safeguarding and forwarding diverse data types effectively.

October 25, 2023

by Pier-Jean MALANDRINO

CORE

· 4,633 Views · 2 Likes

Top CNAPP Tools in 2023

Discover the top CNAPP tools of 2023, ensuring robust cloud-native application security. Stay ahead of evolving threats with these cutting-edge solutions.

October 25, 2023

by Vaibhav Manchanda

· 3,103 Views · 2 Likes

Navigating the Evolutionary Intersection of Big Data and Data Integration Technologies

Exploring the impact of big data on data integration, from challenges like volume and speed to innovative solutions like modern ETL, iPaaS, and AI-driven strategies.

October 25, 2023

by Dana Thomas

· 3,371 Views · 2 Likes

MuleSoft: Do You Have an Extra Mule Under the Hood?

The design principle of separation of concerns can be seen in action in this article, which presents a real-life example of MuleSoft.

October 25, 2023

by Alex Bogomol

· 5,897 Views · 1 Like

Building a Real-Time Data Architecture With Apache Kafka, Flink, and Druid

Data flows are shifting from batch to stream, and data teams are quickly turning to Kafka, Flink, and Druid to power their real-time data applications.

October 25, 2023

by David Wang

· 6,956 Views · 5 Likes

The Latest Data Engineering Topics