Data Engineering Resources

WebRTC Video Calls With Angular and Spring Boot

This in-depth tutorial demonstrates how to add video calls to an Angular/Spring Boot project with WebRTC in TypeScript.

August 23, 2022

by Sven Loesekann

· 8,742 Views · 6 Likes

In this "Today I learned" post, learn how to generate workload data for CockroachDB for offline use, decode hex data into human-readable form, and more.

Updated August 23, 2022

by Artem Ervits

CORE

· 6,409 Views · 2 Likes

On Some Aspects of Big Data Processing in Apache Spark, Part 4: Versatile JSON and YAML Parsers

In this post, I present versatile JSON and YAML parsers for a Spark application.

August 23, 2022

by Alexander Eleseev

CORE

· 6,368 Views · 2 Likes

Increase Your Vector Database Read Throughput with In-Memory Replicas

Use in-memory replicas to enhance read throughput and the utilization of hardware resources.

August 23, 2022

by Charles Xie

· 4,781 Views · 3 Likes

On Some Aspects of Big Data Processing in Apache Spark, Part 3: How To Deal With Malformed Data?

In this post I present some solutions on how to deal with malformed date/time data, and on how to set a default value for malformed data.

August 23, 2022

by Alexander Eleseev

CORE

· 5,562 Views · 2 Likes

When Microservices Are a Bad Idea

Microservices are not always the way.

Updated August 23, 2022

by Tomas Fernandez

· 10,670 Views · 14 Likes

Cloud Data: Observability Is the Forgotten Data

In this continuation of the cloud data series, discuss the forgotten data that is often overlooked when planning for cloud-native architectural solutions.

August 23, 2022

by Eric D. Schabell

CORE

· 5,988 Views · 2 Likes

How to Plant the Right Cybersecurity Seeds to Create Opportunities in IoT

This article explains how the latest security best practices offer opportunities in the IoT landscape within the limits of trust and reliability.

August 23, 2022

by Deepak Gupta

· 6,770 Views · 1 Like

Approaches to Cloud-Native Application Security

Securing a cloud-native application properly is not trivial. API gateways and mutual trust are key to ensuring our communication channels are kept safe.

August 23, 2022

by Nuwan Dias

· 6,620 Views · 4 Likes

Building a Data Pipeline Using QuestDB and Confluent Kafka

Let's dive into a tutorial on how to build a data pipeline using Confluent Kafka, QuestDB, and Python.

August 23, 2022

by Sooter Saalu

· 6,278 Views · 1 Like

API Proxy vs. API Gateway: What Are the Differences and Which Should You Use?

Choosing between using an API proxy and API gateway is a crucial decision for your APIs.

August 23, 2022

by Matt Tanner

· 7,723 Views · 3 Likes

Simplify Your Microservices Architecture With a Data API

In this post, learn how adopting a data API gateway dramatically reduces development and maintenance costs for microservices architectures.

August 23, 2022

by Jeffrey Carpenter

· 19,782 Views · 14 Likes

Feature Store - Why Do You Need One?

How to set up a data architecture that saves your data scientists time and effort.

August 22, 2022

by Roger Oriol

· 5,253 Views · 1 Like

Open-Source SPL Boosts MongoDB Computing Ability

SPL helps MongoDB increase its ability to compute, accomplish grouping and aggregation, joins, subqueries, and all other computing tasks.

August 22, 2022

by Jerry Zhang

· 3,779 Views · 1 Like

Data Pipeline Orchestration

In this article, I share an idea of what a data pipeline orchestration model might look like.

August 22, 2022

by Ivan Nikitsenka

· 7,634 Views · 2 Likes

Role of AI and ML in DevOps Transformation

The role of AI and ML in DevOps transformation is to help manage and automate the process of software development, testing, and delivery.

August 22, 2022

by Fawad Mohsin

· 5,865 Views · 2 Likes

Popular Design Patterns for Microservices Architectures

In this article, learn about the most important design patterns that are essential to building and developing a microservices application.

August 22, 2022

by Rajesh Bhojwani

· 20,067 Views · 10 Likes

Bun - What Can I Use It For?

What is Bun, the new hot thing in the Javascript world? Why is it so fast and can I use it for my projects?

August 21, 2022

by Roger Oriol

· 4,773 Views · 1 Like

Bootstrap K3S Data: For Beginners

Let’s take a look at how to create an initially well created cluster for managing bootstrap data with a description of K3S and High availability (HA) clusters.

Updated August 21, 2022

by Hrittik Roy

· 8,815 Views · 2 Likes

Setup Jira With MySQL Docker.

Learn how to set up Jira with MySQL docker.

August 21, 2022

by Chandra Shekhar Pandey

· 7,901 Views · 2 Likes

The Latest Data Engineering Topics