Data Engineering Resources

The Stairway to Apache Kafka® Tiered Storage

Tiered Storage, a feature of Apache Kafka 3.6 which allows the offloading of data to object storage in the cloud, is a prime example of the power of open source.

September 28, 2023

by Matthew de Detrich

· 4,301 Views · 5 Likes

Down the Rabbit Hole of an Apache APISIX Plugin

In this article, the author explores custom plugins and checks the parameters of the _M.access(conf, ctx) function, especially the ctx one.

September 28, 2023

by Nicolas Fränkel

CORE

· 2,474 Views · 2 Likes

Exploring String Reversal Algorithms: Techniques for Reversing Text Efficiently

In this article, we will explore different string reversal algorithms, discuss their approaches, analyze their time and space complexities.

September 28, 2023

by Aditya Bhuyan

· 4,187 Views · 3 Likes

Mastering the Trino Connection: Unleash the Power of DbVisualizer!

Explore Trino's distributed SQL query capabilities and harness DbVisualizer's intuitive interface for data exploration, visualization, and optimization.

September 28, 2023

by Ochuko Onojakpor

CORE

· 4,694 Views · 2 Likes

A Guide to Data-Driven Design and Architecture: Key Principles, Patterns, and Considerations

Explore the importance of data-driven design patterns and principles. Look at an example of how the data-driven approach works with AI and ML model development.

September 28, 2023

by Boris Zaikin

CORE

· 10,235 Views · 6 Likes

AWS Lambda vs. Fargate: The Battle of Cloud Giants

Discover the ultimate showdown between AWS Lambda and Fargate. Uncover the pros and cons of each cloud giant to make an informed decision for your specific needs.

September 28, 2023

by Satrajit Basu

CORE

· 3,838 Views · 2 Likes

Running End-To-End Tests in GitHub Actions

In this post, you'll learn how to run the Cypress action to execute browser-based tests and how to run the Newman Docker image to execute API tests.

September 28, 2023

by Matthew Casperson

· 5,691 Views · 8 Likes

Post-Pandemic Cybersecurity: Lessons Learned and Predictions

The pandemic has highlighted cybersecurity weaknesses and sped up digital changes. This article discusses these lessons and predicts future trends.

September 28, 2023

by Burak Cinar

· 3,258 Views · 3 Likes

Advancements in Mobile App Testing: Harnessing AI's Potential

Traditional software testing has been a thorn in developers' sides. It demands significant time, resources, and investment. But new advances in AI are shaking things up.

September 28, 2023

by Syed Hamid

· 2,700 Views · 1 Like

AWS vs. Azure vs. Google Cloud: Comparing the Top Cloud Providers

This post will compare AWS, Azure, and Google Cloud from different perspectives to help you choose the best cloud provider.

September 28, 2023

by Adarsh Parikh

· 2,422 Views · 1 Like

The API-Centric Revolution: Decoding Data Integration in the Age of Microservices and Cloud Computing

APIs are overtaking traditional ETL methods in data integration. Adopting an API-first model is now a strategic necessity for businesses.

September 27, 2023

by Andrea Arnold

· 3,194 Views · 3 Likes

Five Tools for Data Scientists to 10X their Productivity

AI tools can help data scientists maximize their productivity by automating mundane and recurring tasks. Find out more about how!

September 27, 2023

by Mirza Arique Alam

· 2,442 Views · 1 Like

Advancements in Computer Vision: Deep Learning for Image Recognition

In this article, learn more about the advancements in computer vision. Also, learn about deep learning for image recognition.

September 27, 2023

by Madhuri Hammad

· 2,743 Views · 3 Likes

Driving Digital Transformation Through the Cloud

Oracle CloudWorld keynote discussing digital transformation journeys with industry leaders leveraging cloud and AI to reinvent experiences and business models.

September 27, 2023

by Tom Smith

CORE

· 2,692 Views · 1 Like

Building AI Applications With Java and Gradle

Explore AI development with Java and Gradle using popular libraries like Deeplearning4j, Weka, and Encog through practical code examples.

September 27, 2023

by Arun Pandey

CORE

· 11,581 Views · 6 Likes

What Is a Flaky Test?

Flaky tests can cause confusion for developers by producing inconsistent results, making it difficult to determine if a failure is due to a bug or a flaky test.

September 27, 2023

by Hugo Escafit

· 1,680 Views · 2 Likes

How To Create a Resource Chart in JavaScript

Master interactive resource charts (Gantt charts for resource allocation) with this step-by-step guide using the FIFA World Cup 2022 schedule as a real-world example.

September 27, 2023

by Awan Shrestha

· 3,780 Views · 3 Likes

Conversational Applications With Large Language Models Understanding the Sequence of User Inputs, Prompts, and Responses

This article explains how user inputs are processed, converted into prompts, sent to LLMs, and responses are generated and presented to the user.

September 27, 2023

by Ram Ravishankar

· 3,555 Views · 1 Like

What You Must Know About Rate Limiting

In this article, learn the basics of rate limiting, its advantages, how a rate-limiting system is designed, and the most popular rate-limiting algorithms.

September 27, 2023

by Saurabh Dashora

CORE

· 2,770 Views · 6 Likes

Exploring Graph Algorithms: Navigating and Analyzing Connected Data Structures

In this article, we embark on a journey to explore the realm of graph algorithms along with different types of such algorithms.

September 27, 2023

by Aditya Bhuyan

· 2,951 Views · 3 Likes

The Latest Data Engineering Topics