Data Engineering Resources

Using a common GitHub issue, the author will take the reader through the process of working through an issue on an unfamiliar codebase.

May 17, 2023

by Nicolas Fränkel

CORE

· 2,873 Views · 5 Likes

Insider Threats and Software Development: What You Should Know

Preventing insider threats completely is not always possible, but organizations can minimize the risk and ensure operational resilience if a threat does occur.

May 17, 2023

by Anastasios Arampatzis

· 2,373 Views · 1 Like

Testing Applications With JPA Buddy and Testcontainers

Testcontainers allows us to create a production-like environment for integration testing. Review the most popular case: testing an application’s services and data access layer.

May 17, 2023

by Andrey Belyaev

CORE

· 3,495 Views · 4 Likes

Harnessing the Power of Integration Testing

In this blog post, we'll take a deep dive into the world of integration testing and explore its benefits. Join us on this journey of discovery.

May 17, 2023

by Ruchita Varma

· 2,617 Views · 1 Like

Node Affinity, Node Selector, and Other Ways to Better Control Kubernetes Scheduling

This article outlines basic Kubernetes scheduling concepts, including node selector, node affinity and anti-affinity, and pod affinity and anti-affinity.

May 17, 2023

by Zilvinas Urbonas

· 3,454 Views · 1 Like

Learn how to protect personal data and comply with GDPR regulations. Discover the seven essential measures and understand individual rights.

May 17, 2023

by Sannan Ali Bhatti

· 3,054 Views · 2 Likes

How I Turned My Company’s Docs Into a Searchable Database With OpenAI

In this article, the reader will learn how to make their documents semantically searchable with vector search and OpenAI.

May 17, 2023

by Jacob Marks

· 2,964 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 5,735 Views · 2 Likes

How To Backup and Restore a PostgreSQL Database

In this blog, the author will take the reader through the step-by-step process of how to backup and restore a PostgreSQL database.

May 16, 2023

by Gunter Rotsaert

CORE

· 3,050 Views · 3 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 2,079 Views · 1 Like

How Virtualization Helps Security

Virtualization allows you to create servers, storage devices, and networks all in virtual space — here's why that's beneficial for cybersecurity.

May 16, 2023

by Zac Amos

· 2,940 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 48,773 Views · 6 Likes

Clustered SurrealDB for 1.0.0-beta9

In this post, the author will demonstrate how to set up a distributed SurrealDB cluster that shares a distributed TiKV cluster.

May 15, 2023

by Hugh Kaznowski

· 2,084 Views · 4 Likes

Building a Headless E-Commerce App Using OceanBase and Python

In this blog post, I will demonstrate how to use OceanBase in a Python project. We will create a REST API that serves as the backend of a headless e-commerce app.

May 15, 2023

by Wayne S

· 3,344 Views · 3 Likes

How TiDB Implements Point-In-Time Recovery

Learn how Point-In-Time Recovery (PITR) works in TiDB, an open-source, distributed SQL database, and how it's optimized for stability and performance.

May 15, 2023

by Allen Gao

· 2,117 Views · 1 Like

Five IntelliJ Idea Plugins That Will Change the Way You Code

AI is going to eat all your jobs!!! Haha. No, just kidding. It will have only the non-productive ones. It’s time to work smarter, not harder.

May 15, 2023

by Toxic Dev

· 37,515 Views · 1 Like

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,610 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,459 Views · 3 Likes

Shift Left Testing Tutorial: Comprehensive Guide With Best Practices

This guide explores the shift left approach to testing and how you can use it to improve your software product's quality.

May 15, 2023

by Rhea Dube

· 3,985 Views · 1 Like

Reducing Network Latency and Improving Read Performance With CockroachDB and PolyScale.ai

This tutorial explores how to benefit from lowered latency, increased performance, and reduced infrastructure costs, as well as faster reads in more locations.

May 15, 2023

by Artem Ervits

CORE

· 4,399 Views · 5 Likes

The Latest Data Engineering Topics