Data Engineering Resources

Factors for Determining Optimized File Format for Spark Applications

This article will discuss how to select the optimized file format for Apache Spark applications.

March 14, 2023

by Amlan Patnaik

· 3,088 Views · 2 Likes

This article provides insight into Delta Sharing, how it reduces ELT's complexity, and where it stands, along with other data-sharing solutions.

March 14, 2023

by Sandip Roy

· 3,443 Views · 2 Likes

Building a Real-Time App With Spring Boot, Cassandra, Pulsar, React, and Hilla

In this article, readers will learn how to create a Spring Boot application that connects to Pulsar and Cassandra and displays live data in a React frontend.

March 13, 2023

by Marcus Hellberg

· 7,021 Views · 10 Likes

Loading Pandas DataFrames Into QuestDB

In this article, readers will learn how to improve your time series analysis capability by using the QuestDB Python package to ingest Pandas DataFrames.

March 13, 2023

by Gabor Boros

· 4,171 Views · 1 Like

Uber System Design

This article provides a look into the system design of popular ride-share apps and what databases are used for their implementation.

March 13, 2023

by N K

· 4,019 Views · 2 Likes

SQL To Find Stored Procedure Compilation Error in SQL Server

These system tables are used by database administrators, developers, and other users to manage and maintain SQL Server databases and to automate repetitive tasks.

March 13, 2023

by Suresh Martha

· 3,278 Views · 2 Likes

Challenges and Checklists While Migrating COTS Application to Cloud

This blog discusses the critical challenges and presents a checklist approach to use before one starts the COTS migration.

March 13, 2023

by Sukanta Paul

· 5,352 Views · 1 Like

Hierarchy in MDM: What and Why

In master data management, hierarchy management is an essential component. It allows a comprehensive view of different domains within an organization.

March 13, 2023

by Sasi Kumar Raju Addepalli

· 5,401 Views · 1 Like

How to Setup a Multi-Account CloudWatch Cross Account Observability Using Terraform and CloudFormation Template for Your AWS Organization

This article provides code and automation for implementing multi-account observability for AWS Organizations using Terraform and CloudFormation template.

March 13, 2023

by Soumya Barman

· 5,767 Views · 1 Like

How To Stay Up to Date With the Latest Trends and Technologies in Data Science

In this article, you will discover ways to keep up with the most recent data science trends and technologies.

March 13, 2023

by Stylianos Kampakis

· 10,523 Views · 1 Like

OWASP Kubernetes Top 10

The OWASP Kubernetes Top 10 puts all possible risks in order of overall commonality or probability.

Updated March 13, 2023

by Nigel Douglas

· 13,119 Views · 14 Likes

Implementing PEG in JavaScript

This article explains the basics of parsing and parser expression grammar in JavaScript.

March 13, 2023

by Vinod Pahuja

· 6,306 Views · 2 Likes

Stateful Stream Processing With Memphis and Apache Iceberg

In this article, readers will use a tutorial to learn how to use Apache Iceberg on AWS S3 to process and enrich large scale data, including code and images.

March 12, 2023

by Idan Asulin

· 4,583 Views · 3 Likes

Using GPT-3 in Our Applications

We will provide a detailed guide on how to use the GPT-3 API, including how to set up your API key, generate responses, and access the generated text.

March 12, 2023

by Isaac Alvarez

· 4,010 Views · 1 Like

Facial Recognition and Identification in Computer Vision

Learn how facial recognition and identification works using Python OpenCV, and how it can be implemented.

March 11, 2023

by Joseph owino

· 5,945 Views · 2 Likes

Developers' Guide: How to Execute Lift and Shift Migration

This article reviews lift and shift migration, how to prepare your application, lift and shift migration strategies, and post migration considerations.

March 11, 2023

by Tejas Kaneriya

· 5,089 Views · 1 Like

Unlocking the Power of Elasticsearch: A Comprehensive Guide to Complex Search Use Cases

In this article, readers will use a tutorial to learn about Elasticsearch (built on top of Apache Lucene), its uses, features, and more, including guide code.

March 11, 2023

by lokesh vijay kumar

· 7,859 Views · 5 Likes

What Is Cloud Application Development?

Cloud computing is considered the best possible approach to cost reduction and giving companies more opportunities to grow.

March 10, 2023

by Anastasiia Komendantova

· 4,504 Views · 1 Like

AWS SQS in a Large Scale Application

What is and how to use AWS SQS to scale your application. This article shows readers how to design your internal infrastructure to decouple system components.

March 10, 2023

by Valerio Barbera

· 4,537 Views · 1 Like

3 Main Pillars in ReactJS

This article explains ReactJS and the three main pillars of ReactJS, which are component, state, and props.

March 10, 2023

by Muthuramalingam Duraipandi

· 7,190 Views · 1 Like

The Latest Data Engineering Topics