Data Engineering Resources

REST vs. Message Brokers: Choosing the Right Communication

We’ll delve into the disparities between REST and message brokers in terms of communication, helping you make the right choice for your specific use case.

September 15, 2023

by Shoham Roditi Elimelech

· 10,325 Views · 9 Likes

Application Integration for IoT Devices: A Detailed Guide To Unifying Your Ecosystem

Know how the IoT connects to application integration in this continuously growing and innovating world, and learn IoT strategies to always be up to date.

September 15, 2023

by Pamela Price

· 3,834 Views · 3 Likes

Unraveling LLMs' Full Potential, One Token at a Time With LangChain

LLMs have immense potential across various tasks and domains; however, they may miss the mark on perfection. Add LangChain to the mix and witness heightened capabilities.

September 15, 2023

by Taranjeet Singh

· 3,124 Views · 1 Like

Apache Flink

This tutorial will show you step-by-step how to use Astra as a sink for results computed by Apache Flink, an open-source framework.

September 15, 2023

by Patrick McFadin

· 4,358 Views · 1 Like

Next-Gen Threat Hunting Techniques With SIEM-SOAR Integration

NLP, AI, and ML boost cybersecurity via streamlined data processing, automated incident handling, compliance, and proactive threat detection.

September 15, 2023

by Cheena Shekhawat

· 2,509 Views · 1 Like

Microservices With Apache Camel and Quarkus (Part 5)

After learning how to run our microservices in Minikube in part three of this series, let's look at how to do the same in OpenShift.

September 15, 2023

by Nicolas Duminil

CORE

· 8,030 Views · 6 Likes

Snowflake vs. Data Bricks: Compete To Create the Best Cloud Data Platform

Do you want to get into the race for the best cloud data platform? Take a look at the difference between Snowflake and Data Bricks.

September 15, 2023

by Sanam Naseem

· 3,679 Views · 4 Likes

Messaging Channels in Enterprise Integration Patterns: Enabling Efficient Communication

In this article, we will discuss Messaging Channels in Enterprise Integration Patterns along with the types and their benefits.

September 15, 2023

by Aditya Bhuyan

· 2,115 Views · 2 Likes

What Is Privacy by Design?

Privacy by Design is sometimes considered too abstract. We, therefore, share tips and tactics for engineers to implement each of the seven principles.

September 15, 2023

by Xander W

· 2,178 Views · 1 Like

Mastering Persistence: Why the Persistence Layer Is Crucial for Modern Java Applications

Ignoring the persistence layer in software can cause data problems, slow performance, maintenance issues, and limited adaptability. It's vital for secure, efficient, and flexible applications.

September 15, 2023

by Otavio Santana

CORE

· 6,550 Views · 1 Like

A Better Web3 Experience: Account Abstraction From Flow (Part 1)

Walletless dApps from Flow use account abstraction to improve the web3 user experience. In part one, we walk through how to build the backend for this dApp.

September 15, 2023

by Alvin Lee

CORE

· 3,110 Views · 2 Likes

Log Analysis: How to Digest 15 Billion Logs Per Day and Keep Big Queries Within 1 Second

This article describes a large-scale data warehousing use case to provide reference for data engineers who are looking for log analytic solutions.

September 15, 2023

by Zaki Lu

· 3,646 Views · 3 Likes

How To Use ChatGPT With Python

Are you looking forward to knowing how you can empower ChatGPT with Python? Learn step-by-step how to set up an account in the Kommunicate platform using Python.

September 14, 2023

by Devashish Mamgain

· 2,219 Views · 1 Like

How to Prompt ChatGPT So It Writes Quality Tech Texts for Your Website

Don't ask it to write a long text, provide as many details and specs as possible, use proper language, and check via AI detectors.

September 14, 2023

by Olesia Filipenko

· 1,704 Views · 2 Likes

Cutting Big Data Costs: Effective Data Processing With Apache Spark

In this article, we will delve into strategies to ensure that your data pipeline is resource-efficient, cost-effective, and time-efficient.

September 14, 2023

by Leonid Chashnikov

· 18,947 Views · 5 Likes

Exploring the Structure of Successful Prompts

In this article, the author presents a programmer's handbook for GPTConsole's Bird and Pixie AI Agents for the reader to explore.

September 14, 2023

by Sai Ram Gollapalli

· 1,146 Views · 1 Like

Choosing the Appropriate AWS Load Balancer: ALB vs. NLB

Learn the key differences between Application Load Balancer (ALB) and Network Load Balancer (NLB) to make the right choice for your application.

September 14, 2023

by Satrajit Basu

CORE

· 6,168 Views · 6 Likes

Lua Metatables

Metatables are a powerful feature of Lua that allows you to customize the behavior of tables. They can be used to add new methods to tables.

September 14, 2023

by Dev matt

· 1,323 Views · 1 Like

The Promise of Personal Data for Better Living

Technology knows more about us than we know about ourselves. We can use this knowledge to help customers be more successful, thrive, and have higher-value experiences.

September 14, 2023

by Tom Smith

CORE

· 1,671 Views · 1 Like

16 K8s Worst Practices That Are Causing You Pain (Or Will Soon)

The article emphasizes the importance of understanding and implementing best practices to avoid pitfalls and ensure efficient and secure Kubernetes operations.

September 14, 2023

by Augustinas Stirbis

· 3,761 Views · 2 Likes

The Latest Data Engineering Topics