Data Engineering Resources

Building the Best Kubernetes Test Cluster on MacOS

Matthew Revell-Gordon explores building a local Kubernetes test cluster to mimic cloud-based deployments better using Colima, Kind, and MetalLB.

June 20, 2023

by Matthew Revell-Gordon

· 3,836 Views · 2 Likes

The challenges posed by GDPR’s “Right to be Forgotten” in the context of Apache Kafka and three strategies for overcoming them.

June 20, 2023

by Greg Nuttall

· 2,323 Views · 1 Like

How WeBank Reduced Their Batch Processing Time by 58% With a Scale-Out MySQL Alternative

This article highlights how WeBank leveraged TiDB – an open-source, distributed SQL database, reducing its batch processing time by 58%.

June 20, 2023

by Qiang Cao

· 3,404 Views · 2 Likes

Mastering Proactive Defense: The Changing Face of Threat Hunting

In this article, we will explore the changing landscape of threat hunting and discuss the importance of proactive defense strategies.

June 19, 2023

by Burak Cinar

· 3,236 Views · 2 Likes

Simplify Data Processing With Azure Data Factory REST API and HDInsight Spark

In this blog post, we will explore how to leverage Azure Data Factory and HDInsight Spark to create a robust data processing pipeline.

June 19, 2023

by Amlan Patnaik

· 3,318 Views · 2 Likes

Disrupting the AI Scene With Open Source and Open Innovation

AI's destiny is to be overtaken by small and medium-sized companies leveraging Open Source and Open Innovation. Even Google and OpenAI agree!

June 19, 2023

by Thomas Hansen

CORE

· 3,990 Views · 2 Likes

Mastering Database Unit Testing: A Full Guide and 5 Essential Tools

This guide provides comprehensive insights and five key tools for mastering database unit testing in software development.

June 19, 2023

by Yuliia Saveniuk

· 3,528 Views · 2 Likes

GDPR's impact on data privacy has been well-documented, but how does the regulation impact the actual development process?

June 18, 2023

by Zac Amos

· 4,733 Views · 2 Likes

Database Deadlocks: Reasons and Resolution

Learn about database deadlocks, how they occur, and how to avoid them.

June 18, 2023

by Faheem Sohail

· 4,657 Views · 2 Likes

Virtualization Security Risks and Solutions

Understand the security threats to virtualization platforms and how to overcome them.

June 18, 2023

by Aditya Bhuyan

· 4,629 Views · 1 Like

Spring Cloud: How To Implement Service Discovery (Part 2)

In this article, explore two different architectural approaches to combine Service Discovery and Remote Configuration.

June 16, 2023

by Mario Casari

· 8,476 Views · 5 Likes

The Power of Template-Based Document Generation with NLP and AI in Python

Harness the power of template-based document generation in Python, infused with NLP and AI capabilities. Simplify workflows and innovation in document generation.

June 16, 2023

by Padhma Sree

· 6,702 Views · 2 Likes

Using AWS DMS for Data Migration From On-Premises Oracle 19 to AWS DynamoDB: Insights From Practical Migration

This article provides insights on using AWS DMS for migrating on-premise Oracle tables to AWS DynamoDB, using learnings from real-world migrations.

June 16, 2023

by Kapil Raina

· 5,812 Views · 2 Likes

Unlocking the Power of Data Integration: A Guide to Success

By taking the time to plan and deploy your data integration solution carefully, you can fully utilize your data and generate fresh insights and efficiency.

June 16, 2023

by Pamela Price

· 4,986 Views · 3 Likes

How To Implement Image Segmentation

Image segmentation is important for functions like background changing and cutout. Read on to check out a solution that helps easily implement this feature.

June 16, 2023

by Jackson Jiang

CORE

· 5,431 Views · 1 Like

Forging Druid With Apache Kafka for Real-Time Streaming Analytics

A real-time analytics database called Apache Druid can be leveraged very effectively where real-time ingestion, fast query performance, and high uptime are crucial.

June 16, 2023

by Gautam Goswami

CORE

· 4,527 Views · 1 Like

Microsoft Access: Unveiling the Dual Power of Database and Front-End Development

Learn how Microsoft Access enables developers to harness the dual power of database management and front-end development.

June 16, 2023

by Dmitry Narizhnykh

CORE

· 3,373 Views · 1 Like

Metadata and Config-Driven Python Framework for Big Data Processing Using Spark

Introducing the Metadata and Config-Driven Python Framework for Data Processing with Spark that offers a streamlined and flexible approach to processing big data.

June 16, 2023

by Amlan Patnaik

· 6,493 Views · 4 Likes

Exploring the Benefits of Kubernetes

Here, we’ll delve into the benefits of Kubernetes and explore how it empowers developers to build scalable and portable applications.

June 16, 2023

by Ruchita Varma

· 6,696 Views · 1 Like

Building Resilience With Chaos Engineering and Litmus

In this article, learn to execute chaos engineering to build reliable systems and explore the steps involved in designing a resiliency framework.

June 15, 2023

by Ruturaj Kadikar

· 6,654 Views · 5 Likes

The Latest Data Engineering Topics