Data Engineering Resources

From Metaverse to Generative AI: A Journey of Hype, Reality, and Future Prospects

In the tech world, the Metaverse's allure has dimmed, while generative AI, particularly LLMs, is now in the spotlight. Explore why this shift occurred.

May 18, 2023

by Navveen Balani

· 1,876 Views · 2 Likes

How To Design Reliable IIoT Architecture

Refining your IIoT design is a key part of building strong cybersecurity resilience in the network architecture. Here's how to add security to every layer.

May 18, 2023

by Emily Newton

· 3,530 Views · 2 Likes

Why `fsync()`: Losing Unsynced Data on a Single Node Leads to Global Data Loss

Regardless of the replication mechanism, you must fsync() your data to prevent global data loss in non-Byzantine protocols.

May 18, 2023

by Denis Rystsov

· 2,472 Views · 1 Like

Why Using Generative AI for OKRs Is Generally a Bad Idea

You may want to think twice before jumping on the AI hype train for your OKRs. Security concerns and algorithmic bias can cause your OKRs to cause more harm than good.

May 17, 2023

by James Bohrman

· 1,912 Views · 1 Like

A Deep Dive Into Apache Parquet With ClickHouse — Part 1

Learn out about how to query and write Apache Parquet files in the first post of our series on the popular data exchange format.

May 17, 2023

by Dale McDiarmid

· 2,466 Views · 1 Like

Data Quality Survey: Resolving Data Issues Takes 166% Longer Year Over Year

The second annual State of Data Quality Survey revealed shocking statistics, such as how data quality impacts 31% of revenue on average. Find out what else we uncovered.

May 17, 2023

by Lior Gavish

· 1,550 Views · 1 Like

For the Wit! My First Day With Components

It's a hard pill to swallow that today's Wasm ecosystem is absolutely rife with custom interfaces that only work in one specific scenario.

May 17, 2023

by Kevin Hoffman

· 1,875 Views · 1 Like

Text Classification With BERT

Text classification is a machine learning subfield that teaches computers how to classify text into different categories. In this tutorial, we will use BERT to develop your own text classification model.

May 17, 2023

by Kevin Vu

· 1,666 Views · 1 Like

How the Wrong Content Type Introduced a Vulnerability in Odoo

In this article, Sonar's R&D team will provide an overview of content types and how a minor error resulted in a Cross-Site Scripting vulnerability in Odoo.

May 17, 2023

by Thomas Chauchefoin

· 1,456 Views · 1 Like

Network Virtualization

In this article, we will delve deeper into the concept of network virtualization, its benefits, and the various technologies and protocols used in its implementation.

May 17, 2023

by Aditya Bhuyan

· 2,558 Views · 2 Likes

Working on an Unfamiliar Codebase

Using a common GitHub issue, the author will take the reader through the process of working through an issue on an unfamiliar codebase.

May 17, 2023

by Nicolas Fränkel

CORE

· 2,695 Views · 5 Likes

Insider Threats and Software Development: What You Should Know

Preventing insider threats completely is not always possible, but organizations can minimize the risk and ensure operational resilience if a threat does occur.

May 17, 2023

by Anastasios Arampatzis

· 2,218 Views · 1 Like

Testing Applications With JPA Buddy and Testcontainers

Testcontainers allows us to create a production-like environment for integration testing. Review the most popular case: testing an application’s services and data access layer.

May 17, 2023

by Andrey Belyaev

CORE

· 3,371 Views · 4 Likes

Harnessing the Power of Integration Testing

In this blog post, we'll take a deep dive into the world of integration testing and explore its benefits. Join us on this journey of discovery.

May 17, 2023

by Ruchita Varma

· 2,501 Views · 1 Like

Node Affinity, Node Selector, and Other Ways to Better Control Kubernetes Scheduling

This article outlines basic Kubernetes scheduling concepts, including node selector, node affinity and anti-affinity, and pod affinity and anti-affinity.

May 17, 2023

by Zilvinas Urbonas

· 3,348 Views · 1 Like

Learn how to protect personal data and comply with GDPR regulations. Discover the seven essential measures and understand individual rights.

May 17, 2023

by Sannan Ali Bhatti

· 2,756 Views · 2 Likes

How I Turned My Company’s Docs Into a Searchable Database With OpenAI

In this article, the reader will learn how to make their documents semantically searchable with vector search and OpenAI.

May 17, 2023

by Jacob Marks

· 2,806 Views · 1 Like

Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Learn how to install Pinot Control Plane on Kubernetes, configure your first Pinot cluster, and dive into the control plane features.

May 16, 2023

by AdheipSingh Sadhrao

· 5,492 Views · 2 Likes

How To Backup and Restore a PostgreSQL Database

In this blog, the author will take the reader through the step-by-step process of how to backup and restore a PostgreSQL database.

May 16, 2023

by Gunter Rotsaert

CORE

· 2,937 Views · 3 Likes

Improve Your Data Solution Efficiency With Stream Processing

Today's data solutions—handling myriad data sources and massive data volume—are expensive. Stream processing reduces costs and brings real-time scalability.

May 16, 2023

by Alvin Lee

CORE

· 1,921 Views · 1 Like

The Latest Data Engineering Topics