Data Engineering Resources

Data Security Considerations in Cloud Data Warehouses

In this article, we will discuss the move to cloud data warehouses (CDWs) and security considerations when using them.

May 23, 2022

by Ben Herzberg

· 7,079 Views · 1 Like

Troubleshooting Memory Leaks With Heap Profilers

Learn how to use common heap profilers and how profilers such as Go heap profiler, gperftools, jemalloc, and Bytehound are designed and implemented.

May 22, 2022

by Yexiang Zhang

· 10,114 Views · 1 Like

The End of the Beginning for Apache Cassandra

Know more about Apache Cassandra 4.0 and what's new with Cassandra.

May 22, 2022

by Patrick McFadin

· 4,063 Views · 2 Likes

Pattern Matching for Switch

Let's see how this feature preview has evolved up to Java 19

May 22, 2022

by Claudio De Sio Cesari

· 5,151 Views · 6 Likes

Datafaker: An Alternative to Using Production Data

As developers or testers, we frequently have the need to test our systems. But getting access to realistic or useful data isn't always easy.

May 22, 2022

by Erik Pragt

· 16,846 Views · 12 Likes

Modernizing Testing With Data Pipelines

Learn how data synthesis together with data pipelines can offer a scalable solution to create consistent data resembling real-world needs for testing systems.

May 22, 2022

by Eric D. Schabell

CORE

· 5,874 Views · 3 Likes

ETL, ELT, and Reverse ETL

What are the advantages of ETL? Is ETL preferable to ELT for your data pipeline use cases? Why and when is reverse ETL valuable for your data warehouse (DW)?

May 22, 2022

by Wayne Yaddow

· 8,240 Views · 1 Like

Applying Kappa Architecture to Make Data Available Where It Matters

Let's discuss the Lambda and Kappa architectural styles for data processing at the edge and look at a retail banking customer experience example for Kappa.

May 21, 2022

by Ram Ravishankar

· 8,646 Views · 5 Likes

Challenges to Designing Data Pipelines at Scale

In this article, take an in-depth look into assessing key challenges and solutions to effective data management.

May 21, 2022

by Miguel Garcia

CORE

· 11,990 Views · 3 Likes

June 1-3 Open Source RT-Thread IoT OS Global Tech Conference

Sign up for free!

May 20, 2022

by Nath Abby

· 39,543 Views · 2 Likes

Aggregate Functions in Stargate’s GraphQL API

Get started with aggregate functions in Stargate using its GraphQL API.

Updated May 20, 2022

by Jeff Davies

· 4,899 Views · 1 Like

6 Best Excel VBA Programming Books

In this article, take a look at six of the best Excel VBA programming books.

Updated May 20, 2022

by Vijay Singh Khatri

CORE

· 40,077 Views · 3 Likes

Creating Event-Based Architecture on Top of Existing API Ecosystem

Is it possible to facilitate the creation of event-driven architecture with already available REST APIs? The short answer is yes. Here are some thoughts on how.

May 20, 2022

by Olga Annenko

· 4,626 Views · 2 Likes

AMI and Snapshot Management Using AWS Lambda

This tutorial takes you through the process of creating an AWS Lambda function that goes through EC2 cycles and creates AMIs for instances with tags.

Updated May 19, 2022

by Akhil Teej

· 23,909 Views · 11 Likes

Create a Self-Service Customer Support Chatbot Without Code

This tutorial walks through how to build a smart chatbot to handle customer service, using low-code and no-code solutions from platforms like Infobip Answers.

Updated May 19, 2022

by Alvin Lee

CORE

· 5,321 Views · 4 Likes

AI Survey 2018: Insights and Suggestions

Let's take a look at some insights and suggestions of Artificial Intelligence and Machine Learning as well as explore tools to help you start learning AI.

Updated May 19, 2022

by Sibanjan Das

· 8,518 Views · 5 Likes

A Guide to Test Automation Types, Tools, and Benefits

Why should you have to do all that heavy testing lifting by yourself? Or at all?

Updated May 19, 2022

by Praveen Mishra

· 41,143 Views · 23 Likes

5 Steps to Strengthen API Security

API misconfigurations and the attacks they attract occur more regularly than you might anticipate. Strengthen your API security using these best practices.

Updated May 19, 2022

by Tim Mackey

· 11,033 Views · 12 Likes

Build a Twitter Leaderboard App with Redis and AWS Lambda (Part 1)

Learn step by step how to build a Twitter leaderboard app with Redis and AWS lambda.

Updated May 19, 2022

by Abhishek Gupta

CORE

· 35,681 Views · 3 Likes

Top 11 Cloud Platforms for Internet of Things (IoT)

Looking over the top 11 cloud platforms for Internet of Things (IoT), we highlight the importance of scalability, cost, and connectivity. Click here for more.

Updated May 19, 2022

by Diksha Rana

· 179,020 Views · 11 Likes

The Latest Data Engineering Topics