Data Engineering Resources

How Do You Get Started With Microservices?

In this article, we’ll try to address the question of where to start and what the crucial aspects are that we need to consider with microservices.

Updated February 12, 2021

by Noorain Panjwani

· 9,244 Views · 5 Likes

Graph-Based Recommendation System With Milvus

In this article, we discuss how to build a graph-based recommendation system by using PinSage (a GCN algorithm), DGL package, MovieLens datasets, and Milvus.

February 11, 2021

by Jun Gu

· 12,173 Views · 4 Likes

Docker Hub Rate Limits to Limitless DevOps in the Cloud

This article talks about the recent partnership between Docker and JFrog and how this partnership impacts developers and enterprises positively.

February 11, 2021

by Pavan Belagatti

CORE

· 16,417 Views · 2 Likes

How to Write ETL Operations in Python

Clean and transform raw data into an ingestible format using Python.

February 10, 2021

by Hassan Syyid

· 8,138 Views · 7 Likes

Java 2021: What Frameworks and Trends for This New Year?

Find out what are the trends of the new year in the Java world. Discover the impacts of the new trend of reflectionless frameworks and their impact on architecture.

February 10, 2021

by Otavio Santana

CORE

· 15,694 Views · 10 Likes

Top 7 Affiliate Programs for Testers and Developers

In this post, we bring you the top 7 affiliate programs for developers and testers. Listed are their features, including monetary benefits, for testers.

February 10, 2021

by Garima Tiwari

· 10,700 Views · 8 Likes

go-mysql-mongodb: Replicate Data From MySQL To MongoDB

This tool is relatively lightweight, and only needs to deploy one service for the synchronization of a MySQL instance to MongoDB.

February 10, 2021

by Xiang Wang

· 10,018 Views · 3 Likes

Build a RESTful CRUD Service With Spring Boot, Hibernate, and JPA

A complete guide to writing a RESTful CRUD service using Spring Boot, Hibernate, and JPA, as well as testing the using GET, DELETE, PUT, and POST calls.

February 10, 2021

by Amit Phaltankar

· 20,842 Views · 6 Likes

Setting up Kubernetes Master and Worker Node on Amazon Web Service (AWS)

We want to create a Kubernetes cluster on AWS public cloud. We are going to create a master node and two worker nodes on AWS EC2 instances, as shown below.

February 9, 2021

by Saurav K Mehta

· 10,665 Views · 3 Likes

Observability Vs. Monitoring: Why A Developer Needs Both

Observability Vs. Monitoring: Why A Developer Needs Both. The critical difference between the two lies in the ability to infer a system’s internal state.

February 9, 2021

by nick flewitt

· 4,675 Views · 2 Likes

Centralized Logging for Kafka on Kubernetes With Grafana, Loki, and Promtail.

If there are multiple zookeeper and Kafka pods, a single window would be a boon for administrators. Grafana provides Loki and Promtail this functionality.

February 9, 2021

by Chandra Shekhar Pandey

· 11,985 Views · 2 Likes

How Fit Is Your API? Private, Public, Partner APIs

There are API ''muscles,'' which, depending on the needs of your API, could be developed and enhanced to achieve API success.

February 9, 2021

by David Mckenna

· 7,770 Views · 4 Likes

10 Database Optimization Best Practices for Web Developers

Database optimization has become crucial to web developers for improving the performance of web applications and thus bettering user experience.

February 9, 2021

by Kaarle Varkki

· 30,321 Views · 20 Likes

Shared Schema Strategy With Postgres (Part 1)

Apply the shared schema strategy in Postgres by using the row-level security policy.

February 9, 2021

by Szymon Tarnowski

CORE

· 13,121 Views · 6 Likes

Convert an MP4 Video to GIF in Java

Learn how to transform an MP4 video file into an easily digestible GIF with Java.

February 8, 2021

by Brian O'Neill

CORE

· 5,400 Views · 2 Likes

Using Python for Accounting And Finance Applications

Python’s development is highly robust for Finance and FinTech applications. Python is now the third most popular programming language behind C and Java.

February 7, 2021

by Parth Barot

· 17,350 Views · 3 Likes

How to Run Apache Kafka on Windows

In this step-by-step tutorial, quickly learn how to run Apache Kafka on Windows in a Linux environment backed by WSL 2 to maximize performance and stability.

February 7, 2021

by Jim Galasyn

· 7,157 Views · 7 Likes

ReactJs Pagination: How Do You Page Your Data With React.js Pagination?

This tutorial explains how to page your data with ReactJs Pagination by providing codes and three case examples to assist you.

February 6, 2021

by sasi kiran

· 21,352 Views · 6 Likes

Making Your Data Flow Resiliently With Apache NiFi Clustering

This article discusses the challenges of transferring data into a format that is serviceable for use in analytics, and how to construct a resilient data flow.

February 5, 2021

by Brent Segner

· 9,883 Views · 5 Likes

Serverless Services on AWS: An Overview

This article reviews one cloud provider to help with serverless services; AWS, the leader in cloud computing with various services in one place.

February 5, 2021

by Ivan Shulak

· 28,840 Views · 4 Likes

The Latest Data Engineering Topics