Data Engineering Resources

Using a common GitHub issue, the author will take the reader through the process of working through an issue on an unfamiliar codebase.

May 17, 2023

by Nicolas Fränkel

· 3,328 Views · 5 Likes

Insider Threats and Software Development: What You Should Know

Preventing insider threats completely is not always possible, but organizations can minimize the risk and ensure operational resilience if a threat does occur.

May 17, 2023

by Anastasios Arampatzis

· 3,169 Views · 1 Like

Testing Applications With JPA Buddy and Testcontainers

Testcontainers allows us to create a production-like environment for integration testing. Review the most popular case: testing an application’s services and data access layer.

May 17, 2023

by Andrey Belyaev

· 3,984 Views · 4 Likes

Harnessing the Power of Integration Testing

In this blog post, we'll take a deep dive into the world of integration testing and explore its benefits. Join us on this journey of discovery.

May 17, 2023

by Ruchita Varma

· 3,033 Views · 1 Like

Node Affinity, Node Selector, and Other Ways to Better Control Kubernetes Scheduling

This article outlines basic Kubernetes scheduling concepts, including node selector, node affinity and anti-affinity, and pod affinity and anti-affinity.

May 17, 2023

by Zilvinas Urbonas

· 3,941 Views · 1 Like

Learn how to protect personal data and comply with GDPR regulations. Discover the seven essential measures and understand individual rights.

May 17, 2023

by Muhammad Sannan Ali Bhatti

· 4,108 Views · 2 Likes

How I Turned My Company’s Docs Into a Searchable Database With OpenAI

In this article, the reader will learn how to make their documents semantically searchable with vector search and OpenAI.

May 17, 2023

by Jacob Marks

· 3,308 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 6,552 Views · 2 Likes

How To Backup and Restore a PostgreSQL Database

In this blog, the author will take the reader through the step-by-step process of how to backup and restore a PostgreSQL database.

May 16, 2023

by Gunter Rotsaert

CORE

· 3,439 Views · 3 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 2,727 Views · 1 Like

How Virtualization Helps Security

Virtualization allows you to create servers, storage devices, and networks all in virtual space — here's why that's beneficial for cybersecurity.

May 16, 2023

by Zac Amos

· 3,827 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 49,919 Views · 6 Likes

Clustered SurrealDB for 1.0.0-beta9

In this post, the author will demonstrate how to set up a distributed SurrealDB cluster that shares a distributed TiKV cluster.

May 15, 2023

by Hugh Kaznowski

· 2,268 Views · 5 Likes

Building a Headless E-Commerce App Using OceanBase and Python

In this blog post, I will demonstrate how to use OceanBase in a Python project. We will create a REST API that serves as the backend of a headless e-commerce app.

May 15, 2023

by Wayne S

· 3,800 Views · 3 Likes

How TiDB Implements Point-In-Time Recovery

Learn how Point-In-Time Recovery (PITR) works in TiDB, an open-source, distributed SQL database, and how it's optimized for stability and performance.

May 15, 2023

by Allen Gao

· 2,377 Views · 1 Like

Five IntelliJ Idea Plugins That Will Change the Way You Code

AI is going to eat all your jobs!!! Haha. No, just kidding. It will have only the non-productive ones. It’s time to work smarter, not harder.

May 15, 2023

by Toxic Dev

· 38,813 Views · 1 Like

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,978 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,964 Views · 3 Likes

Shift Left Testing Tutorial: Comprehensive Guide With Best Practices

This guide explores the shift left approach to testing and how you can use it to improve your software product's quality.

May 15, 2023

by Rhea Dube

· 5,051 Views · 1 Like

Reducing Network Latency and Improving Read Performance With CockroachDB and PolyScale.ai

This tutorial explores how to benefit from lowered latency, increased performance, and reduced infrastructure costs, as well as faster reads in more locations.

May 15, 2023

by Artem Ervits

CORE

· 5,406 Views · 5 Likes

The Latest Data Engineering Topics