Data Engineering Resources

Dive Deep Into the Details of an [~Efficient Multi-Threaded Java Web Crawling System~] called Mowglee that uses Geography as the Main Classifying Criteria for Crawling.

Updated February 18, 2021

by Sumith Puri

· 19,343 Views · 12 Likes

How We Trained a Neural Network to Generate Shadows in Photos: Part 1

A step-by-step guide on how to train a generative adversarial network (GAN) to generate shadows in images.

February 18, 2021

by Artyom Nazarenko

· 7,951 Views · 6 Likes

ObjectStore Behavior in Runtime Fabric

Runtime Fabric is a containerized deployment type, where every application deployed is contained within its Mule Runtime; it is its own private Kubernetes Pod.

February 18, 2021

by Sadik Ali

· 7,697 Views · 3 Likes

Intro to Soda SQL: Open Data Testing and Monitoring

How to use Soda SQL, an open data testing, monitoring and profiling tool for data-intensive environments

Updated February 17, 2021

by Tom Baeyens

· 8,546 Views · 4 Likes

Intelligent Vision: AR Contact Lenses Coming Soon?

A company working towards augmented reality contact lenses could revolutionize our daily lives, helping us lead safer, more tech-savvy existences.

February 17, 2021

by Oleg Spilka

· 6,620 Views · 2 Likes

4 Ways to Implement AI in Your Web Design

AI is one of the most remarkable tools available for web developers today; learn how to use its magic to make your website one of the most popular on the web today.

February 17, 2021

by Tahha Ashraf

· 6,471 Views · 2 Likes

Projection Queries: A Way to Optimize Data Traffic

JPA provides several solutions for projection queries and DTO mapping. It is up to us to choose the most appropriate solution for each of our use cases.

Updated February 17, 2021

by Sergiy Pylypets

· 22,869 Views · 7 Likes

What Is a Significant Data Fiduciary?

In this short article, we're going to talk about the significant data fiduciary. And to understand that, we will first have to discuss what a data fiduciary is.

February 17, 2021

by Shibhi Chakravarthy

· 5,504 Views · 3 Likes

Release Pipeline Using Azure DevOps

Extend the basic pipeline which was created in the previous blog by creating a release pipeline that will help us not only automate a deployment but complete the release.

February 17, 2021

by Gaurav Dhimate

· 24,747 Views · 5 Likes

A Gentle Introduction to Event-driven Change Data Capture

How to detect, capture, and propagate changes in source databases to target systems in real-time, event-driven manner

February 16, 2021

by Dunith Dhanushka

CORE

· 3,196 Views · 4 Likes

How to Connect to Splunk Through Anypoint Studio in 10 Steps

A quick, step-by-step tutorial on how to create a Splunk account and connect it to Anypoint Studio using the cloud platform provided by Splunk.

February 16, 2021

by Rajat Vishwakarma

· 7,828 Views · 5 Likes

Microservices and Its Security Patterns

Common security patterns used in most of the API architecture practices

February 15, 2021

by Prince Pratap Singh

· 10,483 Views · 5 Likes

Is Powershell a Programming Language?

A developer tackles the question, 'is Powershell a programming language?' by exploring all the capabilities that Powershell gives to software developers.

February 15, 2021

by Graeme John

· 19,579 Views · 3 Likes

The Why and How of Microservice Messaging in Kubernetes

Struggling with connecting and maintaining microservices in Kubernetes? Let's look at the benefits and difficulties with messaging in Kubernetes.

February 15, 2021

by Michael Bogan

CORE

· 10,238 Views · 6 Likes

Using NGINX to Serve .NET Core, Nodejs, or Static Contents

NGINX is a high-performance HTTP server as well as a reverse proxy. Unlike traditional servers, NGINX follows an event-driven, asynchronous architecture.

February 13, 2021

by Jawad Hasan Shani

CORE

· 31,624 Views · 4 Likes

DataWeave Interview Question: Compare IDs From Two Arrays and Create a New Array

This article will help you practice your DataWeave skills in MuleSoft. We're going to compare IDs from two arrays of objects and create a new array.

February 13, 2021

by Gaurav Dubey

· 16,351 Views · 2 Likes

Microservices and Scaling Strategy

A distributed system can always be scaled in a 3D space, and we need to scale the distributed system to manage the load and having high availability of the website.

February 13, 2021

by Shaamik Mitraa

· 6,034 Views · 3 Likes

Building a Scalable E-Commerce Data Model

Starting to outgrow small business e-commerce software? Use this as a starting point for building an e-commerce data model that’s scalable, flexible, and fast.

February 12, 2021

by James Hickey

· 7,032 Views · 6 Likes

Intro To Apache Kafka: How Kafka Works

Introduction to Apache Kafka: Learn Kafka fundamentals, including the concepts of events, topics, partitions, brokers, replication, producers, and consumers.

February 12, 2021

by Tim Berglund

· 11,015 Views · 16 Likes

Scaling Salesforce Apps Using Heroku Microservices - Part 2

Combining Salesforce with Heroku including Progressive Web Apps (PWAs), using Kafka to scale MQTT protocols, and capturing change events in near real time.

February 12, 2021

by Michael Bogan

CORE

· 9,206 Views · 2 Likes

The Latest Data Engineering Topics