Data Engineering Resources

Scaling CockroachDB to 200k Writes Per Second

In this article, see how to scale CockroachDB to 200k writes per second using RockDB and Pebble.

March 3, 2021

by Artem Ervits

CORE

· 6,246 Views · 5 Likes

The Materialized Path Technique: Tree Structures for Relational Database Systems

Create three-dimensional tree structures in a relational database system using materialized paths.

March 3, 2021

by Thomas Hansen

CORE

· 31,747 Views · 4 Likes

Managing Global Data in Microservice Polyglot Persistence Scenarios

Analyzing the management of global data in a microservices environment where polyglot persistence is adopted

March 2, 2021

by Claudio Guidi

CORE

· 12,345 Views · 10 Likes

Building a Microservice in Perl (Part 1): Designing the API

A brief description of microservices, then jumping into defining one with OpenAPI.

Updated March 2, 2021

by Mark Gardner

CORE

· 4,547 Views · 6 Likes

How To Handle 100k Rows Decision Table in Drools (Part 3)

In this article, I created a prototype to demonstrate how to handle large rows in a decision table with reasonable performance. This is part 3 of the series.

March 2, 2021

by Ryan ZhangCheng

· 7,766 Views · 5 Likes

How To Handle 100k Rows Decision Table in Drools (Part 2)

In this article, I created a prototype to demonstrate how to handle large rows in a decision table with reasonable performance.

March 2, 2021

by Ryan ZhangCheng

· 8,493 Views · 4 Likes

Use Cases for Apache Kafka in Retail

Event streaming with Apache Kafka in the retail industry facilitates real-time omnichannel, Customer 360, inventory management, recommendations, and more.

March 2, 2021

by Kai Wähner

CORE

· 7,581 Views · 9 Likes

Linux Kernel vs. Memory Fragmentation (Part 1)

This post introduces common methods to prevent Linux memory fragmentation, the principle of memory compaction, how to view the fragmentation index, etc.

March 1, 2021

by Wenbo Zhang

· 10,345 Views · 3 Likes

Achieving Micro-frontend Architecture Using Angular Elements

Scaling micro-frontends using Angular elements: Hosting on Azure cloud. The micro-frontends architecture creates a buzz in the web app development world.

Updated March 1, 2021

by Bharat Ghode

· 37,327 Views · 4 Likes

10 Commandments of Microservice Decomposition

In this article, I will try to cover the purposes of terms used while decomposing microservices and try to fit them under one umbrella concept.

March 1, 2021

by Shaamik Mitraa

· 9,413 Views · 5 Likes

SKP's Algorithms and Data Structures #9: Java Problem: Monkeys in the Garden

This Article Series Focuses on Algorithms, Data Structures, or Applying them to Problem Solving. In this Article, We Discuss the Solution to [Monkeys in the Garden] Problem from Techgig.

February 28, 2021

by Sumith Puri

· 4,586 Views · 3 Likes

SKP's Algorithms and Data Structures #6: Java Problem: Active Traders

This Article Series Focuses on Algorithms, Data Structures, or Applying them to Problem Solving. In this Article, We Discuss the Solution to [Active Traders] Problem from Hacker Rank.

February 28, 2021

by Sumith Puri

· 8,372 Views · 3 Likes

SKP's Algorithms and Data Structures #5: Java Problem: Changes in Usernames

This Article Series Focuses on Algorithms, Data Structures, or Applying them to Problem Solving. In this Article, We Discuss the Solution to [Usernames Changes] Problem from Hacker Rank.

February 28, 2021

by Sumith Puri

· 6,801 Views · 3 Likes

Apache Camel Integration with Kafka

This article covers the integration of Apache Camel with Kafka, from setup to testing, with code blocks and plenty of pictures!

February 28, 2021

by Vignesh Prabhu

· 16,733 Views · 1 Like

TDD Typescript NestJS API Layers with Jest Part 3: Repository Unit Test

This is a 3 part series for unit testing the controller, service, and repository layers in a typical REST architecture. The final part shows testing the Repository Unit.

February 28, 2021

by Dale Waterworth

· 15,672 Views · 2 Likes

How to Use IBM App Connect's ‘Mapping Assist’ to Automatically Map Your Integration Flows

This tutorial explains IBM App Connect Mapping Assist's capability to reduce integration flow building time and enable developers to build flows confidently.

February 27, 2021

by Matu Agarwal

· 5,690 Views · 2 Likes

Free Datasets for Machine Learning and Deep Learning

A great, free resource for training data!

February 27, 2021

by Ajitesh Kumar

· 8,365 Views · 2 Likes

How to Use Spring Boot and JHipster With Reactive Java Microservices

Learn how to create a reactive microservices architecture with Spring Boot, Spring Cloud Gateway, Spring Cloud Config, Spring WebFlux, Java, and JHipster.

February 26, 2021

by Matt Raible

· 5,325 Views · 6 Likes

7 Keys to a Successful Salesforce Integration

Salesforce Integration improves functionality across all business applications — here are some strategies one should follow during this integration process.

February 26, 2021

by Richa Pokhriyal

· 4,924 Views · 2 Likes

Get Your Code Together! Submodules, Monorepo: Is There Another Way?

There are various ways to manage modular Git projects - submodules, monorepo, etc. Is there a way to combine the advantages of all approaches?

Updated February 26, 2021

by Dmitry Linov

· 8,698 Views · 8 Likes

The Latest Data Engineering Topics