Data Engineering Resources

Part 3: How to Develop a Data Integration Master Test Plan

In the final data integration series article, we'll show you how to develop a data integration master test plan, the cornerstone of data verification efforts.

August 27, 2020

by Wayne Yaddow

· 5,957 Views · 2 Likes

Tutorial: Data Ingestion From Kafka to Azure Data Explorer

Use the Azure Data Explorer sink connector to ingest data from Apache Kafka.

August 26, 2020

by Abhishek Gupta

CORE

· 7,190 Views · 6 Likes

Raspberry Pi Cluster Emulation With Docker Compose

This guide discusses everything needed to build a simple, scalable, and fully binary compatible Raspberry Pi cluster using QEMU, Docker, Docker Compose, and Ansible.

August 26, 2020

by Sudip Sengupta

CORE

· 15,557 Views · 6 Likes

Grafana Analysis and Visualization with CA APM

This article is an analysis and visualization of Grafana, a multi-platform open-source analytical and visualization tool, with CA APM.

August 26, 2020

by Prem Prakash

· 4,527 Views · 3 Likes

Ultimate Tutorial about Microsoft Graph APIs

This tutorial demonstrates some of the features of Microsoft's Graph API and outlines what you can expect when you use it.

August 26, 2020

by Daria K

· 10,071 Views · 2 Likes

How to Give Access to AWS Resources Without Creating 100s of IAM Users

This post demonstrates the use of AWS Security Token Service to give access to AWS Resources to users that don't exists in AWS IAM.

August 26, 2020

by Rajan Panchal

· 5,551 Views · 3 Likes

Hello World Scala in the Cloud With Spring

In this tutorial, we are going to look at Scala using Spring MVC and MongoDB.

August 26, 2020

by Otavio Santana

CORE

· 13,774 Views · 4 Likes

C++17: Polymorphic Allocators, Debug Resources and Custom Types

In this article, take a look at polymorphic allocators and see how to debug sources and custom types.

August 26, 2020

by Bartłomiej Filipek

· 17,510 Views · 4 Likes

Getting Started With SQLPad and Distributed SQL on Google Kubernetes Engine

See how to install a 3 node YugabyteDB cluster on Google Kubernetes Engine, build the sample Northwind database, build and configure SQLPad, and more!

August 25, 2020

by Jimmy Guerrero

· 6,081 Views · 3 Likes

Microservices for Java EE/Jakarta EE Developers

With this article, our intention is to illustrate that microservices are a valid option for Java/Jakarta EE developers with the help of Payara.

August 25, 2020

by Fabio Turizo

· 8,942 Views · 5 Likes

Json Web Token: How to Secure a Spring Boot REST API

In this post, I show how to secure Spring Boot REST API using Json Web Tokens for authorization. We will also use Spring Security in this tutorial.

August 25, 2020

by Yogesh Mali

· 53,617 Views · 17 Likes

Integrating VTS With JMeter

For this assignment, VTS was the only way to go since we could not provision any DB that quickly and nor could we write our own solution

Updated August 25, 2020

by Shivaram Thirunavukkarasu

· 15,036 Views · 7 Likes

Writing .NET Core Application’s Log Into ElasticSearch With NLog

See how we can take advantage of NLog and ElasticSearch to better track and manage your .NET application's logs.

Updated August 25, 2020

by Matt Ghafouri

· 22,332 Views · 4 Likes

Making the Transition from Software Engineer to Artificial Intelligence Engineer

Even if you're already a Software Engineer, making the transition to AI engineer isn't straightforward. It takes time and a lot of work to successfully transition and make an impact on the industry.

August 24, 2020

by Andrew Zola

· 11,978 Views · 5 Likes

Kubernetes Operators to Realize the Dream of Zero-Touch Ops

Kubernetes Operators has the power to realize the dream of Zero-touch Ops, bringing in AIOps to life…and this is how I believe it will.

August 24, 2020

by A B Vijay Kumar

· 7,436 Views · 4 Likes

WSO2 Token API Invocation From a Mediation Sequence in WSO2 APIM 3.1.0.

In this article, I am going to show how we can invoke WSO2’s token API from a mediation sequence to get the access/bearer token.

August 24, 2020

by Suman Mohan

· 6,990 Views · 3 Likes

Website Hosting with MuleSoft API

In this article, I will give you a scenario of how to package website pages inside a MuleSoft application and deploy it to Anypoint Platform or Cloudhub

Updated August 21, 2020

by Guruprasad Malenki

· 10,598 Views · 4 Likes

Using PostgreSQL pgoutput Plugin for Change Data Capture With Debezium

In this article, see a quick walkthrough on how to use the PostgreSQL pgoutput plugin for change data capture with Debezium.

August 21, 2020

by Abhishek Gupta

CORE

· 18,751 Views · 4 Likes

Why you Should and How to Archive your Kafka Data to Amazon S3

Move data from Apache Kafka to AWS S3 with Kafka Connect in order to reduce storage cost and have a Kafka data recovery option.

August 21, 2020

by Stefan Bocutiu

· 18,090 Views · 5 Likes

High Availability Kubernetes Monitoring Using Prometheus and Thanos

In this article, see a tutorial on how to deploy a clustered prometheus set-up so we can span multiple Kubernetes clusters under the same monitoring umbrella.

August 21, 2020

by Sudip Sengupta

CORE

· 16,993 Views · 4 Likes

The Latest Data Engineering Topics