Data Engineering Resources

Considering Distributed Postgres? How To Evaluate Vendor Claims of Postgres Compatibility

When evaluating a distributed Postgres database system careful consideration should be given to the level of effort required to migrate application code.

March 11, 2024

by Phillip Merrick

· 1,783 Views · 1 Like

Essential Techniques for Performance Tuning in Snowflake

This article outlines the optimization methods and capabilities within Snowflake to enhance performance and lower expenses.

March 11, 2024

by Anandaganesh Balakrishnan

· 10,070 Views · 2 Likes

Geo-Replication

Ensure business continuity and quick disaster recovery as you explore this overview of quorum, global quorum, and the two geo-replication types.

March 11, 2024

by Bhala Ranganathan

· 3,008 Views · 1 Like

Feature Flags and Canary Releases in Microservices

Using feature flags enables continuous and risk-free releases. In this article, we will see how to cautiously use them along with a Java example.

March 11, 2024

by Prasanna J

· 10,541 Views · 3 Likes

From Kotlin Scripting to Python

I recently moved away from Kotlin Scripting to Python. In this post, I want to explain my reasons and document the migration.

March 11, 2024

by Nicolas Fränkel

CORE

· 1,237 Views · 1 Like

Beyond the Call: AI and Machine Learning’s Role in Evolving Vishing Cyber Threats

The social engineering tactic of vishing is a growing problem; you must understand it first in order to properly defend yourself.

March 11, 2024

by Luis Maldonado

· 2,232 Views · 1 Like

Streaming Real-Time Data From Kafka 3.7.0 to Flink 1.18.1 for Processing

Flink seamlessly integrates with Kafka and offers robust support for exactly-once semantics, ensuring each event is processed precisely once. Learn more here.

March 10, 2024

by Gautam Goswami

CORE

· 10,718 Views · 2 Likes

Seamless Integration: Connecting AWS Lambda to RDS and Writing Data Effortlessly

This comprehensive guide walks you through the process of setting up AWS Lambda to connect to an RDS instance and write data to tables, step-by-step.

March 9, 2024

by Vijay Panwar

CORE

· 7,145 Views · 1 Like

Solix Empowers the Data-Driven Enterprise With Comprehensive Data Management and Integration Solutions

How Solix helps data-driven enterprises manage and integrate data to get more value for more people with less time and less money.

March 9, 2024

by Tom Smith

CORE

· 5,928 Views · 1 Like

A Developer's Guide to Database Sharding With MongoDB

Database sharding improves performance by distributing data across multiple shards. Use MongoDB to easily implement various sharding strategies.

March 9, 2024

by Arun Pandey

CORE

· 7,311 Views · 4 Likes

Why Do We Need Databases and SQL?

To beginners in the software industry, it can be blurry to see the actual need for relational databases and SQL. Let's fix that.

March 8, 2024

by Alejandro Duarte

CORE

· 99,121 Views · 5 Likes

Performing Advanced Facebook Event Data Analysis With a Vector Database

In this post, discover a comprehensive application designed to scrape event data from Facebook and analyze the scraped data using MyScale.

March 8, 2024

by Usama Jamil

· 3,047 Views · 2 Likes

Why GraphQL Is a Superior Choice for Building Microservices?

In the evolving landscape of software development, the debate between using REST and GraphQL for building microservices is becoming increasingly relevant.

March 8, 2024

by Santhosh Krishnan

· 3,807 Views · 2 Likes

The State of Observability 2024: Navigating Complexity With AI-Driven Insights

The report reveals the challenges of complex multi-cloud environments and the need for advanced AI, analytics, and automation.

March 8, 2024

by Tom Smith

CORE

· 5,791 Views · 1 Like

Python in Urban Planning

This article explores the role of Python in urban planning, highlighting its importance in leveraging data analysis and programming for sustainable city development.

March 8, 2024

by Konstantin Berezin

· 10,927 Views · 1 Like

Introduction to Modern Data Stack

Exploring how the modern data stack revolutionizes data management with scalable cloud solutions, automated tools, and advanced analytics capabilities.

March 8, 2024

by Suhas Jangoan

· 4,881 Views · 5 Likes

How a Distributed File System in Go Reduced Memory Usage by 90%

Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.

March 8, 2024

by Sandy Xu

· 2,354 Views · 1 Like

Use Different Data Formats Under Single Resource in RAML Specification

In this article, we will discuss how to use different data types with different formats under a single resource in a RAML Specification.

March 7, 2024

by Vidya Bogaram

· 4,276 Views · 1 Like

How to Load Data From MongoDB to Postgres Destination

In this article, learn how to use Airbyte to synchronize your MongoDB data with your Postgres destination within minutes.

March 7, 2024

by John Lafleur

· 2,365 Views · 1 Like

Harnessing the Power of SIMD With Java Vector API

In this article, explore Vector API, a feature that allows harnessing the power of SIMD (Single Instruction, Multiple Data) directly within Java applications.

March 7, 2024

by Andrei Tuchin

CORE

· 14,913 Views · 8 Likes

The Latest Data Engineering Topics