Data Engineering Resources

Time Synchronization in Distributed Systems: TiDB's Timestamp Oracle

This article is an introduction to PingCAP's TiDB’s timestamp oracle (TSO), how it delivers time services, and its strengths and weaknesses.

May 12, 2022

by haitao gao

· 7,232 Views · 2 Likes

IoT Product Development Guide for Startups

75% of IoT projects fail. To avoid this scenario, you should carefully plan your project beforehand and familiarize yourself with the IoT product development stages.

May 12, 2022

by Roman Lapa

· 11,094 Views · 2 Likes

Untangling the Potential of IoT Protocols and Standards

How IoT Protocols and Standards Support Secure Data Exchange in the IoT Ecosystem?

May 12, 2022

by Amit Srivastava

· 11,311 Views · 4 Likes

Getting Started With Redis on AWS the Easy Way

This quick-start guide demonstrates how to use AWS Cloud9 IDE to help you get up and running with MemoryDB for Redis.

May 12, 2022

by Abhishek Gupta

CORE

· 39,518 Views · 3 Likes

Database Migration tools: Flyway vs Liquibase

Learning and choosing a migration tool for yor project? Deepening your knowledge about Flyway and Liquibase will give you new insight for efficient workflow.

Updated May 11, 2022

by Bartłomiej Żyliński

CORE

· 71,098 Views · 15 Likes

Transactions vs. Analytics in Apache Kafka

This blog post explores when and how to use Kafka in resilient, mission-critical architectures and when to use the built-in Transaction API.

May 11, 2022

by Kai Wähner

CORE

· 5,062 Views · 3 Likes

Choosing Between GraphQL Vs REST

GraphQL is a query language standard, whereas REST is an architectural idea for network-based computing.server.

May 11, 2022

by Tetiana Stoyko

· 5,344 Views · 4 Likes

How to Hash, Salt, and Verify Passwords in NodeJS, Python, Golang, and Java

How to hash and salt passwords in different languages and why it's important to do so.

May 11, 2022

by Advait Ruia

· 9,000 Views · 1 Like

Businesses Discover the Shocking Cost of Bad Data

Poor data is an overlooked crisis affecting many businesses, so steps to improve data quality must be taken.

May 11, 2022

by Ryan Kh

· 4,019 Views · 2 Likes

Kafka Fail-Over Using Quarkus Reactive Messaging

Learn about a scenario where, at first glance, I needed an active-active Kafka cluster with bi-directional replication. What happened as I dove deeper?

May 11, 2022

by Raffael Mendes

· 7,322 Views · 2 Likes

Securely Authenticate to Google Cloud From GitHub

Learn how to authenticate to GCP and a suite of tools from GitHub.

Updated May 10, 2022

by Nicolas Fränkel

· 3,607 Views · 2 Likes

How to Handle a Many-to-Many Relationship in Database Design

Handling a one-to-one relationship or one-or-many relationship can be done pretty simply. But many-to-many relationships are a bit different. Let’s look at an example.

Updated May 10, 2022

by Ben Brumm

· 550,096 Views · 12 Likes

Managing the requirements of GDPR compliance is easier said than done. Mehdi Medjaoui shares some advice on how to facilitate GDPR compliance through APIs.

May 10, 2022

by David Brown

CORE

· 3,945 Views · 4 Likes

How the TypeScript Parameters Type Works

Let's take a look at how the TypeScript Parameters Utility type works.

Updated May 10, 2022

by Johnny Simpson

· 2,397 Views · 4 Likes

Counting Faster With Postgres

Explore how count and distinct queries work behind the scenes, how to make them run faster, and alternative approaches to the problem of speed.

May 10, 2022

by Zach Naimon

· 4,257 Views · 3 Likes

A Smarter Redis

Redis is fast, easy to use from almost any programming language, and works exactly as it should. Redis is even better with a programmable database proxy.

May 10, 2022

by Max Tardiveau

· 7,256 Views · 3 Likes

Ultra-Fast Microservices: When MicroStream Meets Wildfly

In the second part of the ultra-fast series, In this article, learn a new database that can make your microservices scale up quickly in the Java world!

Updated May 10, 2022

by Otavio Santana

CORE

· 18,057 Views · 9 Likes

Is Java Still Relevant?

Java is widely used in different ways, especially by popular platforms you might often use, such as Twitter, Google, Amazon, Spotify, and YouTube.

Updated May 9, 2022

by Swathi Nelabhatla

· 61,134 Views · 24 Likes

Comparing Akka Streams, Kafka Streams and Spark Streaming

We'll discuss the pros and cons of the frameworks and which to use when.

Updated May 9, 2022

by Daniel Ciocirlan

· 23,925 Views · 3 Likes

OPC-UA, MQTT, and Apache Kafka: The Trinity of Data Streaming in IoT

Learn about Apache Kafka, MQTT, and OPC-UA for data streaming in IoT and Industry 4.0, including architectures, comparisons, and examples from Audi and BMW.

May 9, 2022

by Kai Wähner

CORE

· 11,000 Views · 10 Likes

The Latest Data Engineering Topics