Data Engineering Resources

Kappa Architecture is Mainstream Replacing Lambda

This blog post explores why a single real-time pipeline, called Kappa architecture, is the better fit and the role of batch processing in it without requiring Lambda.

November 3, 2021

by Kai Wähner

CORE

· 7,494 Views · 8 Likes

AWS S3 Access via API Gateway, IaC, and More

If you are currently developing or looking to start developing apps on the AWS serverless stack, then keep on reading for useful and interesting insights.

November 2, 2021

by David Shilman

CORE

· 10,167 Views · 8 Likes

How to Use Active Storage on Rails 6.2

Learn how to use active storage in Rails 6.2. including its definition, installation, and functionalities as well as major updates in recent releases.

November 1, 2021

by Ritu Chaturvedi

· 5,696 Views · 1 Like

How to Perform a NestJS TypeORM Transaction Using QueryRunner?

In this post, we will look at how to perform a NestJS TypeORM Transaction using the TypeORM QueryRunner class with examples.

October 31, 2021

by Saurabh Dashora

CORE

· 9,042 Views · 2 Likes

MDC Logging With MuleSoft Runtime 4.4

With MDC Logging, logs can be enriched by providing more information about the event in the logs.

October 30, 2021

by Jitendra Bafna

CORE

· 19,804 Views · 3 Likes

Connect to a Database Instance Running Inside a Java Testcontainer Using IntelliJ IDEA

Learn how to use IntelliJ IDEA along with Testcontainers and JUnit to write effective unit tests for your Java module that communicate with databases.

October 27, 2021

by Sumit Kumar

· 5,713 Views · 2 Likes

How to Enable Subscription in Apollo Federation With NestJS GraphQL

By default, Apollo does not allow you to enable subscription in a federation server. Here's how to enable subscription in NestJS using Apollo GraphQL.

October 26, 2021

by Vinod Surendran

· 6,433 Views · 2 Likes

How to Build a Metadata-Driven UI

A metadata-driven UI provides project teams with element alignment by invoking a single endpoint for data. Here's how to build your own metadata-driven UI.

October 26, 2021

by Sergei Visotsky

· 8,763 Views · 3 Likes

Ultra-fast Java In-Memory Database Apps & Microservices with MicroStream

MicroStream is a fundamentally new persistence framework for storing complex Java object graphs natively, which means the object graph is stored on disk as it is in RAM.

October 26, 2021

by Otavio Santana

CORE

· 15,262 Views · 5 Likes

Using pgbench With CockroachDB Serverless

In this tutorial, we're going to briefly review how we can use PGBench utility to benchmark CockroachDB.

October 26, 2021

by Artem Ervits

CORE

· 5,952 Views · 3 Likes

Confluent Kafka Installation and Demo

Learn how to insert rows to SQLite-DB and show those rows on an auto-created topic on Kafka via the JDBC-source connector.

October 26, 2021

by Ersin Gulbahar

· 5,327 Views · 2 Likes

How to Check DAG Health Status for All Exchange Servers

Although DAG provides protection against data loss and helps prevent downtime, it is susceptible to failures. Here's how to check its health status.

October 26, 2021

by Shelly Bhardwaj

· 39,005 Views · 2 Likes

Using LoopBack Connectors With IBM App Connect Enterprise

Learn how to issue synchronous requests to backend data sources by using LoopBack connectors in IBM App Connect Enterprise.

October 25, 2021

by Sowmya Grama

· 12,667 Views · 3 Likes

Text Preprocessing Methods for Deep Learning

Learn the various perspectives of preprocessing steps for deep learning neural networks related to any Natural Language Processing (NLP) problem.

October 25, 2021

by Kevin Vu

· 8,337 Views · 2 Likes

Spinnaker Meets Minikube: Part 1

Get started with Spinnaker and learn how to run various microservices on a Minikube cluster using Halyard and Docker.

October 25, 2021

by Jan-Rudolph Bührmann

· 8,606 Views · 3 Likes

How to Migrate Your Data From Redshift to Snowflake

How to configure a Redshift Airbyte source and a Snowflake Airbyte destination, and create an Airbyte connection that automatically migrates data to Snowflake.

October 25, 2021

by John Lafleur

· 10,009 Views · 3 Likes

How to Use OpenAPI for Secure and Robust API Integration

How the OpenAPI Specification was created and how adopting OAS will remove headaches and bring confidence back to your third-party API integrations.

October 25, 2021

by Michael Bogan

CORE

· 6,866 Views · 3 Likes

A Deep Dive into AWS Control Tower — An Innovative Multi-Account Management Solution

AWS Control Tower is fairly easy to use. The service supports the full automation of setup processes for multi-account environments as well as governance policies.

October 24, 2021

by Mariano D

· 8,795 Views · 4 Likes

Amazon Lambda Connector: Mule 4

Bring your Mule projects to the serverless world.

October 23, 2021

by Nitin Gupta

CORE

· 15,423 Views · 3 Likes

CockroachDB Grants and Schemas Explained

See some common tasks related to granting non-admin users privileges on CockroachDB tables and schemas, and learn why the results you get may not be what you are expecting.

October 22, 2021

by John Sheaffer

· 6,052 Views · 3 Likes

The Latest Data Engineering Topics