Data Engineering Resources

Geo-Replication

Ensure business continuity and quick disaster recovery as you explore this overview of quorum, global quorum, and the two geo-replication types.

March 11, 2024

by Bhala Ranganathan

CORE

· 4,601 Views · 3 Likes

Feature Flags and Canary Releases in Microservices

Using feature flags enables continuous and risk-free releases. In this article, we will see how to cautiously use them along with a Java example.

March 11, 2024

by Prasanna J

· 12,417 Views · 3 Likes

From Kotlin Scripting to Python

I recently moved away from Kotlin Scripting to Python. In this post, I want to explain my reasons and document the migration.

March 11, 2024

by Nicolas Fränkel

· 1,583 Views · 1 Like

Beyond the Call: AI and Machine Learning’s Role in Evolving Vishing Cyber Threats

The social engineering tactic of vishing is a growing problem; you must understand it first in order to properly defend yourself.

March 11, 2024

by Luis Maldonado

· 3,006 Views · 1 Like

Streaming Real-Time Data From Kafka 3.7.0 to Flink 1.18.1 for Processing

Flink seamlessly integrates with Kafka and offers robust support for exactly-once semantics, ensuring each event is processed precisely once. Learn more here.

March 10, 2024

by Gautam Goswami

CORE

· 11,956 Views · 2 Likes

Seamless Integration: Connecting AWS Lambda to RDS and Writing Data Effortlessly

This comprehensive guide walks you through the process of setting up AWS Lambda to connect to an RDS instance and write data to tables, step-by-step.

March 9, 2024

by Vijay Panwar

CORE

· 9,307 Views · 1 Like

Solix Empowers the Data-Driven Enterprise With Comprehensive Data Management and Integration Solutions

How Solix helps data-driven enterprises manage and integrate data to get more value for more people with less time and less money.

March 9, 2024

by Tom Smith

CORE

· 6,785 Views · 1 Like

A Developer's Guide to Database Sharding With MongoDB

Database sharding improves performance by distributing data across multiple shards. Use MongoDB to easily implement various sharding strategies.

March 9, 2024

by Arun Pandey

CORE

· 8,429 Views · 4 Likes

Why Do We Need Databases and SQL?

To beginners in the software industry, it can be blurry to see the actual need for relational databases and SQL. Let's fix that.

March 8, 2024

by Alejandro Duarte

CORE

· 100,121 Views · 5 Likes

Performing Advanced Facebook Event Data Analysis With a Vector Database

In this post, discover a comprehensive application designed to scrape event data from Facebook and analyze the scraped data using MyScale.

March 8, 2024

by Usama Jamil

· 3,485 Views · 2 Likes

Why GraphQL Is a Superior Choice for Building Microservices?

In the evolving landscape of software development, the debate between using REST and GraphQL for building microservices is becoming increasingly relevant.

March 8, 2024

by Santhosh Krishnan

· 4,453 Views · 2 Likes

The State of Observability 2024: Navigating Complexity With AI-Driven Insights

The report reveals the challenges of complex multi-cloud environments and the need for advanced AI, analytics, and automation.

March 8, 2024

by Tom Smith

CORE

· 7,211 Views · 1 Like

Python in Urban Planning

This article explores the role of Python in urban planning, highlighting its importance in leveraging data analysis and programming for sustainable city development.

March 8, 2024

by Konstantin Berezin

· 13,000 Views · 1 Like

Introduction to Modern Data Stack

Exploring how the modern data stack revolutionizes data management with scalable cloud solutions, automated tools, and advanced analytics capabilities.

March 8, 2024

by Suhas Jangoan

· 6,166 Views · 5 Likes

How a Distributed File System in Go Reduced Memory Usage by 90%

Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.

March 8, 2024

by Sandy Xu

· 2,824 Views · 1 Like

Use Different Data Formats Under Single Resource in RAML Specification

In this article, we will discuss how to use different data types with different formats under a single resource in a RAML Specification.

March 7, 2024

by Vidya Bogaram

· 13,134 Views · 1 Like

How to Load Data From MongoDB to Postgres Destination

In this article, learn how to use Airbyte to synchronize your MongoDB data with your Postgres destination within minutes.

March 7, 2024

by John Lafleur

· 3,272 Views · 1 Like

Harnessing the Power of SIMD With Java Vector API

In this article, explore Vector API, a feature that allows harnessing the power of SIMD (Single Instruction, Multiple Data) directly within Java applications.

March 7, 2024

by Andrei Tuchin

CORE

· 22,905 Views · 8 Likes

Mitigating Adversarial Attacks: Strategies for Safeguarding AI Systems

This article explores key strategies for mitigating adversarial manipulation and ensuring robust operations in real-world applications.

March 7, 2024

by Ram N

· 3,670 Views · 3 Likes

Why DevOps Should Own Their Databases and How To Do It

It took us nearly 20 years to finally formulate the state of DevOps and bridge development and operations. However, we need to take another step to own the databases.

March 7, 2024

by Adam Furmanek

CORE

· 2,981 Views · 2 Likes

The Latest Data Engineering Topics