Data Engineering Resources

What is Data Lineage and How Can It Ensure Data Quality?

By providing a clear representation of the flow of data, a data lineage system essentially allows you to have your cake and eat it too.

November 10, 2021

by Michael Bogan

CORE

· 4,614 Views · 2 Likes

Tutorial: How to Define SQL Functions With Presto Across All Connectors

Learn how to implement your own SQL function with Presto, the open-source SQL query engine.

Updated November 9, 2021

by Rohan Pednekar

· 5,520 Views · 4 Likes

How to Use SingleStore With Spark ML for Fraud Detection

In this 3-part series of articles, we’ll see how easy it is to use the SingleStore Spark Connector and the performance benefits it provides.

November 9, 2021

by Akmal Chaudhri

CORE

· 8,393 Views · 2 Likes

Test-Driven Development With The oclif Testing Library: Part One

Let’s build something different but simple. We’ll use a test-driven development (TDD) approach to build a time-tracking application.

November 8, 2021

by Michael Bogan

CORE

· 7,979 Views · 1 Like

Encryption Key Lifecycle Management: Tools and Best Practices

How secure are your encryption keys? Discover the best tools and practices for effective encryption key management to avoid a data breach.

November 7, 2021

by Milica Dancuk

· 5,426 Views · 2 Likes

Concurrency-Safe Execution Using Ballerina Isolation

The concept of isolation in Ballerina simplifies development by ensuring the safety of shared resources during concurrent execution.

November 7, 2021

by Hinduja Balasubramaniyam

· 6,822 Views · 3 Likes

Auto_Explain: How to Log Slow Postgres Query Plans Automatically

Automatically log slow query plans with auto_explain and learn how to fix the problematic PostgreSQL queries that are slowing you down.

November 7, 2021

by Anton Bjorkman

· 3,821 Views · 3 Likes

DevOps Toolchain for Beginners

DevOps toolchain plays a crucial role in automating and orchestrating DevOps capabilities to deliver software at the desired speed and quality.

November 7, 2021

by Vishnu Vasudevan

· 24,171 Views · 11 Likes

From Spring Boot Microservices to Lambda Functions

Get your microservices where they need to be.

November 6, 2021

by Ben Foster

· 33,489 Views · 10 Likes

Untraceable Communication is Here

Spies have been using physical "Dead Drops" to exchange information securely for decades. This method of communication has become possible online with recent cryptographic advances.

November 6, 2021

by Robert Brautigam

· 5,037 Views · 2 Likes

Using Machine Learning for Log Analysis and Anomaly Detection: A Practical Approach to Finding the Root Cause

Learn a practical approach to using Machine Learning for Log Analysis and Anomaly Detection in the article below.

November 5, 2021

by Max Shash

CORE

· 26,499 Views · 7 Likes

Spring Boot Pet Clinic App: A Performance Study

This article sets out to conduct a performance test on the Spring Boot Pet Clinic application to see whether any performance bottlenecks can be identified.

November 5, 2021

by Ram Lakshmanan

CORE

· 11,046 Views · 8 Likes

Lambda Architecture is one of the most useful frameworks to design big data applications and distributed data processing systems like social network platforms.

November 5, 2021

by Phani Krishna Kollapur Gandla

· 6,326 Views · 3 Likes

Saying "NO" - A Superpower

In this article, we will take a look at the power of saying No — having the flexibility and willingness to stand by what is important and speak your mind.

November 5, 2021

by Anand Safi

· 8,052 Views · 5 Likes

Easy Local Development with TiDB

Here's how TiDB can help you develop your application locally using the same type of distributed database platform used in production.

November 4, 2021

by Daniël Van Eeden

· 4,766 Views · 1 Like

Data Table Filtering Using a D3 Timeline

A step-by-step tutorial on how to use Angular framework, D3.js, and Bootstrap to implement data filtering and visualization using a D3 timeline.

November 4, 2021

by Maksym Mostovyi

· 7,589 Views · 1 Like

Challenges of AI in the Media Industry and How Developers Are Facing It

As the media industry joins others by adopting AI to improve user experience, many developers are facing new challenges and higher stakes on the backend.

Updated November 4, 2021

by Abhilash Dasari

· 10,705 Views · 5 Likes

Single Responsibility Principle: The Most Important Rule in the Software World

Do you want to know the most important singular rule in the world of software engineering? Here you can learn why it should matter to all engineers.

November 3, 2021

by Bartłomiej Żyliński

CORE

· 9,659 Views · 9 Likes

How to Avoid Stalling in Reactive Java Applications

We'll go over some core Reactor principles, introduce the Scheduler abstraction, describe how it's used to encapsulate blocking code, and more.

November 3, 2021

by Jimena Garbarino

· 3,223 Views · 1 Like

Top 8 Recommended Books To Become a Better Programmer

This article contains a series of top 8 recommended books to improve your programming skills. Each book is an addition to a developer's skills and an interesting read. From concurrency, design patterns, refactoring, and microservices this list covers it all.

November 3, 2021

by Bhagyashree Nigade

· 49,243 Views · 22 Likes

The Latest Data Engineering Topics