Data Engineering Resources

Learn how to scale Prometheus using Thanos for long-term storage, global view metrics, and improved performance in large-scale Kubernetes environments.

August 5, 2024

by Ritesh Sonawane

· 3,502 Views · 5 Likes

Reimagining AI: Ensuring Trust, Security, and Ethical Use

How can we trust AI in our daily lives? Explore the balance between innovation and safety in the age of intelligent systems.

August 5, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,773 Views · 2 Likes

Building an IoT-based Waste Management System: A Software Architect's Guide

Explore how IoT waste management optimizes collection, reduces costs, and enhances sustainability using smart bins, mobile apps, and analytics.

August 5, 2024

by Arun Pandey

CORE

· 4,990 Views · 2 Likes

Streaming Data Joins: A Deep Dive Into Real-Time Data Enrichment

Unravel the complexities of streaming data joins in this guide covering key concepts, design, and best practices for optimal real-time data enrichment.

August 5, 2024

by Preet Shah

· 4,226 Views · 4 Likes

Building a To-Do List With MongoDB and Golang

In this article, consider how you can write your small service in Go in a couple of hours and put everything in a database.

August 5, 2024

by Ilia Ivankin

· 2,174 Views · 1 Like

Free Tier API With Apache APISIX

A free tier is a must for any API service provider worth its salt. In this post learn how to configure such a free tier with Apache APISIX.

August 5, 2024

by Nicolas Fränkel

CORE

· 1,895 Views · 1 Like

Harnessing the Power of AWS Aurora for Scalable and Reliable Databases

Delve into the benefits of AWS Aurora and explore a real-life example of how it is used in an online social media platform.

August 5, 2024

by Vijay Panwar

CORE

· 2,677 Views · 3 Likes

Overview of Classical Time Series Analysis: Techniques, Applications, and Models

Explore what makes time series analysis unique and the specialized techniques and models needed to understand and predict future patterns or trends.

August 5, 2024

by Salman Khan

CORE

· 52,838 Views · 30 Likes

Upgrading Spark Pipelines Code: A Comprehensive Guide

Discuss the strategic importance of Spark code upgrades and explore an introduction to a powerful toolkit designed to streamline this process: Scalafix.

August 5, 2024

by Suri Nuthalapati

CORE

· 25,021 Views · 1 Like

Automation Resilience: The Hidden Lesson of the CrowdStrike Debacle

Read here to discover the as-yet uncovered culprit in this massive hunt for the responsible parties for the recent CrowdStrike debacle: automation.

August 5, 2024

by Jason Bloomberg

· 1,839 Views · 4 Likes

Industrial IoT: Exploring Microcontrollers for Robust Applications

Let's explore the features, applications, and top choices for microcontrollers in industrial IoT, achieving reliability, efficiency, and security in harsh environments.

August 2, 2024

by Carsten Rhod Gregersen

· 4,906 Views · 1 Like

Criticality in Data Stream Processing and a Few Effective Approaches

Opposite to traditional batch data processing technique, here processing works on the data as it is produced in real-time. Learn more in this post.

August 2, 2024

by Gautam Goswami

CORE

· 5,192 Views · 1 Like

Software Testing Errors to Look Out For (With Examples)

Explore the main purposes of software testing, which include identifying errors, deficiencies, or missing requirements with respect to actual requirements.

August 2, 2024

by Amir Ali

· 2,668 Views · 1 Like

The C̶a̶k̶e̶ User Location Is a Lie!!!

This post discusses the nuances surrounding location-based programming: various ways to access user location, how they can fail, and what to do about it.

August 2, 2024

by Austin Gil

CORE

· 5,741 Views · 2 Likes

The One-Pixel Threat: How Minuscule Changes Can Fool Deep Learning Systems

Learn about how a single pixel can compromise deep learning models from medical diagnostics to autonomous vehicles, and the challenges to securing our AI future.

August 1, 2024

by Frederic Jacquet

CORE

· 3,871 Views · 2 Likes

My Journey to Master SQL Data Analysis

This article delves into the experience of a data analyst tackling real-life challenges and explores why mastering SQL is key to achieving success.

August 1, 2024

by Sia L.

· 2,768 Views · 1 Like

3 Reasons Why VPs of Engineering Are Choosing Low-Code

Low-code helps VPs of engineers to let their core engineering team focus more on high-impact projects, save costs, and speed up application development.

August 1, 2024

by Aaikansh Agrawal

· 3,096 Views · 1 Like

Navigating BNPL Integration: Key Steps and Best Practices for Developers

Integrating BNPL boosts conversion rates and satisfaction. This guide covers key steps and best practices for seamless, secure implementation.

August 1, 2024

by Lohith Kumar Paripati

· 5,128 Views · 2 Likes

How to Fix the OWASP Top 10 Vulnerability in Angular 18.1.1v

Discuss the configurations and see examples of how to mitigate security vulnerabilities in an Angular web application 18.1.1v in detail.

August 1, 2024

by Kalyan Gottipati

· 5,738 Views · 1 Like

Leveraging Time Series Databases for Cutting-Edge Analytics: Specialized Software for Providing Timely Insights at Scale

Time series databases offer tools that simplify working with temporal data, enabling businesses to improve operational efficiency, predict failures, and enhance security.

August 1, 2024

by Ted Gooch

· 4,508 Views · 1 Like

The Latest Data Engineering Topics