Data Engineering Resources

How to Avoid Stalling in Reactive Java Applications

We'll go over some core Reactor principles, introduce the Scheduler abstraction, describe how it's used to encapsulate blocking code, and more.

November 3, 2021

by Jimena Garbarino

· 3,176 Views · 1 Like

Top 8 Recommended Books To Become a Better Programmer

This article contains a series of top 8 recommended books to improve your programming skills. Each book is an addition to a developer's skills and an interesting read. From concurrency, design patterns, refactoring, and microservices this list covers it all.

November 3, 2021

by Bhagyashree Nigade

· 49,145 Views · 22 Likes

Aggregating REST APIs Calls Using Apache Camel

In this post, we are going to build an aggregator for API calls using the Enricher EIP. A tutorial on how to aggregate sequential calls to REST APIs in a single response.

November 3, 2021

by André Luiz De Gusmão

· 23,045 Views · 2 Likes

Kappa Architecture is Mainstream Replacing Lambda

This blog post explores why a single real-time pipeline, called Kappa architecture, is the better fit and the role of batch processing in it without requiring Lambda.

November 3, 2021

by Kai Wähner

CORE

· 8,019 Views · 8 Likes

AWS S3 Access via API Gateway, IaC, and More

If you are currently developing or looking to start developing apps on the AWS serverless stack, then keep on reading for useful and interesting insights.

November 2, 2021

by David Shilman

· 10,636 Views · 8 Likes

How to Use Active Storage on Rails 6.2

Learn how to use active storage in Rails 6.2. including its definition, installation, and functionalities as well as major updates in recent releases.

November 1, 2021

by Ritu Chaturvedi

· 5,816 Views · 1 Like

How to Perform a NestJS TypeORM Transaction Using QueryRunner?

In this post, we will look at how to perform a NestJS TypeORM Transaction using the TypeORM QueryRunner class with examples.

October 31, 2021

by Saurabh Dashora

CORE

· 9,699 Views · 2 Likes

MDC Logging With MuleSoft Runtime 4.4

With MDC Logging, logs can be enriched by providing more information about the event in the logs.

October 30, 2021

by Jitendra Bafna

· 20,688 Views · 3 Likes

Connect to a Database Instance Running Inside a Java Testcontainer Using IntelliJ IDEA

Learn how to use IntelliJ IDEA along with Testcontainers and JUnit to write effective unit tests for your Java module that communicate with databases.

October 27, 2021

by Sumit Kumar

· 5,959 Views · 2 Likes

How to Enable Subscription in Apollo Federation With NestJS GraphQL

By default, Apollo does not allow you to enable subscription in a federation server. Here's how to enable subscription in NestJS using Apollo GraphQL.

October 26, 2021

by Vinod Surendran

· 6,788 Views · 2 Likes

How to Build a Metadata-Driven UI

A metadata-driven UI provides project teams with element alignment by invoking a single endpoint for data. Here's how to build your own metadata-driven UI.

October 26, 2021

by Sergei Visotsky

· 10,608 Views · 3 Likes

Ultra-fast Java In-Memory Database Apps & Microservices with MicroStream

MicroStream is a fundamentally new persistence framework for storing complex Java object graphs natively, which means the object graph is stored on disk as it is in RAM.

October 26, 2021

by Otavio Santana

CORE

· 15,871 Views · 5 Likes

Using pgbench With CockroachDB Serverless

In this tutorial, we're going to briefly review how we can use PGBench utility to benchmark CockroachDB.

October 26, 2021

by Artem Ervits

CORE

· 6,463 Views · 3 Likes

Confluent Kafka Installation and Demo

Learn how to insert rows to SQLite-DB and show those rows on an auto-created topic on Kafka via the JDBC-source connector.

October 26, 2021

by Ersin Gulbahar

· 6,143 Views · 3 Likes

How to Check DAG Health Status for All Exchange Servers

Although DAG provides protection against data loss and helps prevent downtime, it is susceptible to failures. Here's how to check its health status.

October 26, 2021

by Shelly Bhardwaj

· 47,168 Views · 2 Likes

Using LoopBack Connectors With IBM App Connect Enterprise

Learn how to issue synchronous requests to backend data sources by using LoopBack connectors in IBM App Connect Enterprise.

October 25, 2021

by Sowmya Grama

· 13,119 Views · 3 Likes

Text Preprocessing Methods for Deep Learning

Learn the various perspectives of preprocessing steps for deep learning neural networks related to any Natural Language Processing (NLP) problem.

October 25, 2021

by Kevin Vu

· 8,725 Views · 2 Likes

Spinnaker Meets Minikube: Part 1

Get started with Spinnaker and learn how to run various microservices on a Minikube cluster using Halyard and Docker.

October 25, 2021

by Jan-Rudolph Bührmann

· 9,367 Views · 3 Likes

How to Migrate Your Data From Redshift to Snowflake

How to configure a Redshift Airbyte source and a Snowflake Airbyte destination, and create an Airbyte connection that automatically migrates data to Snowflake.

October 25, 2021

by John Lafleur

· 10,578 Views · 3 Likes

How to Use OpenAPI for Secure and Robust API Integration

How the OpenAPI Specification was created and how adopting OAS will remove headaches and bring confidence back to your third-party API integrations.

October 25, 2021

by Michael Bogan

CORE

· 7,406 Views · 3 Likes

The Latest Data Engineering Topics