Data Engineering Resources

DataWeave Interview Question: Compare IDs From Two Arrays and Create a New Array

This article will help you practice your DataWeave skills in MuleSoft. We're going to compare IDs from two arrays of objects and create a new array.

February 13, 2021

by Gaurav Dubey

· 16,169 Views · 2 Likes

Microservices and Scaling Strategy

A distributed system can always be scaled in a 3D space, and we need to scale the distributed system to manage the load and having high availability of the website.

February 13, 2021

by Shaamik Mitraa

· 5,997 Views · 3 Likes

Building a Scalable E-Commerce Data Model

Starting to outgrow small business e-commerce software? Use this as a starting point for building an e-commerce data model that’s scalable, flexible, and fast.

February 12, 2021

by James Hickey

· 6,964 Views · 6 Likes

Intro To Apache Kafka: How Kafka Works

Introduction to Apache Kafka: Learn Kafka fundamentals, including the concepts of events, topics, partitions, brokers, replication, producers, and consumers.

February 12, 2021

by Tim Berglund

· 10,890 Views · 16 Likes

Scaling Salesforce Apps Using Heroku Microservices - Part 2

Combining Salesforce with Heroku including Progressive Web Apps (PWAs), using Kafka to scale MQTT protocols, and capturing change events in near real time.

February 12, 2021

by Michael Bogan

CORE

· 9,082 Views · 2 Likes

How Do You Get Started With Microservices?

In this article, we’ll try to address the question of where to start and what the crucial aspects are that we need to consider with microservices.

Updated February 12, 2021

by Noorain Panjwani

· 9,172 Views · 5 Likes

Graph-Based Recommendation System With Milvus

In this article, we discuss how to build a graph-based recommendation system by using PinSage (a GCN algorithm), DGL package, MovieLens datasets, and Milvus.

February 11, 2021

by Jun Gu

· 12,072 Views · 4 Likes

Docker Hub Rate Limits to Limitless DevOps in the Cloud

This article talks about the recent partnership between Docker and JFrog and how this partnership impacts developers and enterprises positively.

February 11, 2021

by Pavan Belagatti

CORE

· 16,331 Views · 2 Likes

How to Write ETL Operations in Python

Clean and transform raw data into an ingestible format using Python.

February 10, 2021

by Hassan Syyid

· 8,071 Views · 7 Likes

Java 2021: What Frameworks and Trends for This New Year?

Find out what are the trends of the new year in the Java world. Discover the impacts of the new trend of reflectionless frameworks and their impact on architecture.

February 10, 2021

by Otavio Santana

CORE

· 15,588 Views · 10 Likes

Top 7 Affiliate Programs for Testers and Developers

In this post, we bring you the top 7 affiliate programs for developers and testers. Listed are their features, including monetary benefits, for testers.

February 10, 2021

by Garima Tiwari

· 10,532 Views · 8 Likes

go-mysql-mongodb: Replicate Data From MySQL To MongoDB

This tool is relatively lightweight, and only needs to deploy one service for the synchronization of a MySQL instance to MongoDB.

February 10, 2021

by Xiang Wang

· 9,973 Views · 3 Likes

Build a RESTful CRUD Service With Spring Boot, Hibernate, and JPA

A complete guide to writing a RESTful CRUD service using Spring Boot, Hibernate, and JPA, as well as testing the using GET, DELETE, PUT, and POST calls.

February 10, 2021

by Amit Phaltankar

· 20,775 Views · 6 Likes

Setting up Kubernetes Master and Worker Node on Amazon Web Service (AWS)

We want to create a Kubernetes cluster on AWS public cloud. We are going to create a master node and two worker nodes on AWS EC2 instances, as shown below.

February 9, 2021

by Saurav K Mehta

· 10,621 Views · 3 Likes

Observability Vs. Monitoring: Why A Developer Needs Both

Observability Vs. Monitoring: Why A Developer Needs Both. The critical difference between the two lies in the ability to infer a system’s internal state.

February 9, 2021

by nick flewitt

· 4,618 Views · 2 Likes

Centralized Logging for Kafka on Kubernetes With Grafana, Loki, and Promtail.

If there are multiple zookeeper and Kafka pods, a single window would be a boon for administrators. Grafana provides Loki and Promtail this functionality.

February 9, 2021

by Chandra Shekhar Pandey

· 11,887 Views · 2 Likes