Data Engineering Resources

Node Affinity, Node Selector, and Other Ways to Better Control Kubernetes Scheduling

This article outlines basic Kubernetes scheduling concepts, including node selector, node affinity and anti-affinity, and pod affinity and anti-affinity.

May 17, 2023

by Zilvinas Urbonas

· 3,846 Views · 1 Like

Learn how to protect personal data and comply with GDPR regulations. Discover the seven essential measures and understand individual rights.

May 17, 2023

by Muhammad Sannan Ali Bhatti

· 3,996 Views · 2 Likes

How I Turned My Company’s Docs Into a Searchable Database With OpenAI

In this article, the reader will learn how to make their documents semantically searchable with vector search and OpenAI.

May 17, 2023

by Jacob Marks

· 3,250 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 6,473 Views · 2 Likes

How To Backup and Restore a PostgreSQL Database

In this blog, the author will take the reader through the step-by-step process of how to backup and restore a PostgreSQL database.

May 16, 2023

by Gunter Rotsaert

CORE

· 3,339 Views · 3 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 2,654 Views · 1 Like

How Virtualization Helps Security

Virtualization allows you to create servers, storage devices, and networks all in virtual space — here's why that's beneficial for cybersecurity.

May 16, 2023

by Zac Amos

· 3,704 Views · 1 Like

Explainable AI: Making the Black Box Transparent

Explainable AI (XAI) has been gaining popularity among tech enthusiasts, data scientists, and software engineers in a world where AI is becoming more prevalent.

May 16, 2023

by Yifei Wang

CORE

· 49,770 Views · 6 Likes

Clustered SurrealDB for 1.0.0-beta9

In this post, the author will demonstrate how to set up a distributed SurrealDB cluster that shares a distributed TiKV cluster.

May 15, 2023

by Hugh Kaznowski

· 2,216 Views · 5 Likes

Building a Headless E-Commerce App Using OceanBase and Python

In this blog post, I will demonstrate how to use OceanBase in a Python project. We will create a REST API that serves as the backend of a headless e-commerce app.

May 15, 2023

by Wayne S

· 3,730 Views · 3 Likes

How TiDB Implements Point-In-Time Recovery

Learn how Point-In-Time Recovery (PITR) works in TiDB, an open-source, distributed SQL database, and how it's optimized for stability and performance.

May 15, 2023

by Allen Gao

· 2,336 Views · 1 Like

Five IntelliJ Idea Plugins That Will Change the Way You Code

AI is going to eat all your jobs!!! Haha. No, just kidding. It will have only the non-productive ones. It’s time to work smarter, not harder.

May 15, 2023

by Toxic Dev

· 38,684 Views · 1 Like

Sixty ChatGPT Prompts for Scrum Masters and Product Owners

A prompt engineering guide covering the basics, services to enhance your prompts, and how to use ChatGPT to generate prompts. (Yub, that works, too.)

May 15, 2023

by Stefan Wolpers

CORE

· 3,917 Views · 1 Like

GPT3.5-Turbo Versus GPT4

We tested GPT3.5-turbo against GPT4 in our website chatbot, and here are the results. TL-DR? GPT4 is better but not worth it.

May 15, 2023

by Thomas Hansen

CORE

· 2,886 Views · 3 Likes

Shift Left Testing Tutorial: Comprehensive Guide With Best Practices

This guide explores the shift left approach to testing and how you can use it to improve your software product's quality.

May 15, 2023

by Rhea Dube

· 4,896 Views · 1 Like

Reducing Network Latency and Improving Read Performance With CockroachDB and PolyScale.ai

This tutorial explores how to benefit from lowered latency, increased performance, and reduced infrastructure costs, as well as faster reads in more locations.

May 15, 2023

by Artem Ervits

CORE

· 5,316 Views · 5 Likes

Improve Application Latency With Read Replicas Using YugabyteDB [Video]

Learn how to optimize read latency for users worldwide by utilizing YugabyteDB's read replica nodes. Achieve scalability and low latency for real-time data.

May 15, 2023

by Denis Magda

CORE

· 4,893 Views · 2 Likes

Microservices Decoded: Unraveling the Benefits, Challenges, and Best Practices for APIs

Unlocking the Power of Microservices: Embrace Flexibility, Scalability, and Independent Development for Your Application's Success.

May 15, 2023

by Piyush Tripathi

· 9,983 Views · 10 Likes

Boosting Similarity Search With Stream Processing

See a hybrid approach taking the strengths of vector databases, and boosting it with traditional search and filtering techniques based on real-time stream processing.

May 15, 2023

by Fawaz Ghali, PhD

CORE

· 4,383 Views · 2 Likes

Six Best-In-Class AI Tools Every CTO Needs To Know

Don't fall behind in the AI revolution of software engineering. Our list of the six best AI tools for CTOs will keep you ahead of the game.

May 12, 2023

by Alex Omeyer

· 6,230 Views · 1 Like

The Latest Data Engineering Topics