Data Engineering Resources

Using the Airflow ShortCircuitOperator to Stop Bad Data from Reaching ETL Pipelines

See how to leverage the Airflow ShortCircuitOperator to create data circuit breakers to prevent bad data from reaching your data pipelines.

September 3, 2022

by Lior Gavish

· 7,188 Views · 1 Like

Logistics Automation to Strengthen Process Efficiency

Automation in logistics undoubtedly will aid shippers in increasing efficiency, minimizing waste, and, most significantly, saving money.

September 3, 2022

by Biswarup Bhattacharjee

· 6,589 Views · 2 Likes

Row Level Security in Hyperlambda and SQL

Row level security in Hyperlambda and SQL is a declarative feature when generating your CRUD backend. One simple dropdown list, and it’s done!

September 3, 2022

by Thomas Hansen

CORE

· 5,606 Views · 2 Likes

Error Handling via Dead Letter Queue in Apache Kafka

Dead Letter Queue for error handling in Apache Kafka: Alternatives, best practices, and case studies from Uber and Crowdstrike.

September 3, 2022

by Kai Wähner

CORE

· 8,141 Views · 7 Likes

Database Replication: Open-Source Tools and Options

Business systems generate large amounts of data, needing tools to manage it. Learn open-source tools for DB and stream-based replication for real-time.

September 2, 2022

by Ravi Kiran Mallidi

CORE

· 13,109 Views · 5 Likes

How to Securely Configure an AWS EC2 Instance

AWS EC2 is one of AWS's most popular and widely used services. In this article, learn some of the ways that can help configure our EC2 instances securely.

September 2, 2022

by Richa Nevatia

· 6,403 Views · 1 Like

Why Radiologists in the Healthcare Sector Will Gain From AI

The latest technologies like AI and machine learning might change the healthcare industry. What can AI offer radiologists to improve their performance?

September 2, 2022

by Matthew McMullen

· 7,271 Views · 1 Like

The Database CI/CD Best Practice With GitHub

Database change is a tricky part of the development process. Can we treat databases the same way we treat code by making it part of the CI/CD cycle?

September 2, 2022

by Cayden Wang

· 8,796 Views · 3 Likes

End-to-End Tracing With OpenTelemetry

Tracing is one of the pillars of observability. This article focuses solely on traces and describes how you can start your journey into observability.

September 2, 2022

by Nicolas Fränkel

CORE

· 9,101 Views · 3 Likes

Building Microservices Using Spring Boot and Docker

This step-by-step guide helps full-stack developers build components in microservices using Spring Boot and employ them in Docker.

Updated September 1, 2022

by Shamik Mitra

· 161,049 Views · 107 Likes

103 Ethereum Solidity Developer Interview Questions

Need help passing your next interview on Solidity? This article provides you with top Solidity interview questions and answers so you can become an Ethereum Solidity Developer.

Updated September 1, 2022

by Polina Kurbatova

· 19,446 Views · 11 Likes

How to Use JWTs for Client-Side Auth With GraphQL

In this article, we will dig deep into best practices in implementing JWT on the client side while keeping security considerations in mind.

September 1, 2022

by Tanmai Gopal

· 5,068 Views · 2 Likes

CockroachDB TIL: Volume 9

In this latest "Today I learned" post, audit schema change events, configure Linode Cloud Storage for CockroachDB bulk ops, and lots of DBeaver goodness.

September 1, 2022

by Artem Ervits

CORE

· 5,369 Views · 3 Likes

Blockchain Case Using Kubernetes

This article shows how we used Kubernetes and microservices architecture to build a crypto solution with complex functionality.

September 1, 2022

by Tetiana Stoyko

· 6,886 Views · 1 Like

Implement Testcontainers GCloud Module With Spring Boot for Writing Integration Tests

This article explains how to write integration tests using the Testcontainers GCloud module for the Spanner database using Spring Boot.

August 31, 2022

by Sameer Shukla

CORE

· 7,626 Views · 1 Like

Testing Multi Experience Apps Using Real Device Cloud

Learn why testing multi-experience apps on a real-device cloud will build and shape the future of interactive web and mobile applications.

August 31, 2022

by Vivek Mannotra

· 6,758 Views · 1 Like

How to Paraphrase Text in Python Using NLP Libraries

In Python, transformers are the deep learning models that are used for NLP and paraphrasing. This guide uses the online paraphrasing tool to paraphrase Python text.

August 31, 2022

by Bilal Mohsin

· 18,958 Views · 3 Likes

Cloud Data: FinOps Is the Crucial Ops

This third and final article of the cloud data series explores a new operations role that is going to be the most crucial one in your organization.

August 31, 2022

by Eric D. Schabell

CORE

· 8,058 Views · 3 Likes

Error Handling in Spring for GraphQL

Let's discuss error handling in Spring for GraphQL. We will also look at the ErrorHandler implementation that's capable of handling the custom and built-in exceptions.

August 31, 2022

by Ion Pascari

· 18,102 Views · 6 Likes

API Analytics Across the Developer Journey

API providers want as many developers as possible to adopt and use their APIs. But what metrics matter most to the developer journey? The answer is in the data.

August 30, 2022

by Derric Gilling

CORE

· 3,773 Views · 1 Like

The Latest Data Engineering Topics