Data Engineering Resources

From Code to Insight: Using NLP and Sentiment Analysis in Git History

In this article, I will explain how to utilize technical textual data to transform traditional team management and achieve better results.

May 28, 2024

by Pavel Perfilov

· 25,779 Views · 102 Likes

MuleSoft: API Experience Hub vs. API Community Manager vs. Anypoint Exchange

This blog presents a comparison study of platforms for management, discovery, and the utilization of APIs, highlighting the differences and similarities of each.

May 28, 2024

by PRAVEEN SUNDAR

· 3,114 Views · 10 Likes

Streamlining Data Warehouse Migrations From RedShift, Snowflake, and BigQuery to Apache Doris

Migrate Redshift, Snowflake, and BigQuery to Apache Doris for high-performance OLAP using tools like Apache Nifi, Talend, and Python.

May 28, 2024

by Sameer Danave

· 1,681 Views · 2 Likes

Fast Setup: Golang and Testcontainers

Most of the time, our scripts set up an entire test environment right on our computers, but why? In the test environment, we have everything, but we need it?

May 28, 2024

by Ilia Ivankin

· 2,594 Views · 2 Likes

Preventing and Fixing Bad Data in Event Streams (Part 1)

In this blog, we’ll take a look at how bad data may come to be, and how we can deal with it when it comes to event streams.

May 28, 2024

by Adam Bellemare

· 4,476 Views · 3 Likes

Building an AI-Powered Slack Bot With IBM WatsonX

Leverage WatsonX's AI capabilities to create innovative applications that streamline processes and boost productivity, making life easier and more productive for users.

May 28, 2024

by Pradeep Gopalgowda

· 2,577 Views · 7 Likes

Microservices: Consistent State Propagation With Debezium Engine

Learn challenges of state propagation across different (micro)services, architectural patterns for such challenges, and an implementation using Debezium Engine.

May 28, 2024

by David Cano

· 2,799 Views · 3 Likes

ARM CPU for Cost-Effective Apache Kafka at the Edge and Cloud

Learn about ARM CPU for cost-effective and energy-efficient data streaming with Apache Kafka at the Edge and in the Cloud, including use cases.

May 27, 2024

by Kai Wähner

CORE

· 2,981 Views · 1 Like

Less Time Learning, More Time Building

Secure cloud adoption no longer requires an investment in proprietary cloud infra knowledge, allowing teams to implement security that aligns with the business.

May 27, 2024

by John Vester

CORE

· 66,024 Views · 2 Likes

Firebase Genkit With Ollama

Explore a Firebase project that uses the Gen AI Kit with Gemma using Ollama and learn how to test it locally with the Firebase emulator and the Gen UI Kit.

May 27, 2024

by Xavier Portilla Edo

CORE

· 2,261 Views · 1 Like

Upgrade Your Hobbyist Arduino Firmware To Work With STM32 For Wider Applications

Running out of processing power or memory? Want better timing control of your functions? Here, get started with making the switch to 32-bit ARM-based MCUs.

May 27, 2024

by Akanksha Jhunjhunwala

· 2,191 Views · 2 Likes

Bridging the Gap: Exploring Innovative Paths in Data Integration

This article solely focuses on delving into understanding data integrations, associated challenges, emerging technologies, and advanced methodologies.

May 27, 2024

by Yash Mehta

· 1,381 Views · 1 Like

API Testing With Playwright

Modern software development requires API testing, and Playwright offers a strong, adaptable framework for building thorough API test suites.

May 27, 2024

by Kailash Pathak

CORE

· 4,897 Views · 5 Likes

Leveraging AI and Vector Search in Azure Cosmos DB for MongoDB vCore

This article explains the inbuilt vector search functionality in Cosmos DB for MongoDB vCore and also provides a quick exploration guide using Python code.

May 26, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 3,862 Views · 3 Likes

Apache Doris for Log and Time Series Data Analysis

NetEase has replaced Elasticsearch and InfluxDB with Apache Doris, achieving 11X query performance and saving 70% of resources.

May 25, 2024

by Shirley H.

· 2,146 Views · 1 Like

How To Protect Node.js Form Uploads With a Deterministic Threat Detection API

Learn more about the prevalence of custom file upload forms in web applications and a deterministic threat detection solution for Node.js form uploads.

May 24, 2024

by Brian O'Neill

CORE

· 3,553 Views · 2 Likes

Application Task Driven: LLM Evaluation Metrics in Detail

List of common LLM systems evaluation metrics that are based on specific applications and a supporting open-source framework.

May 24, 2024

by Sapan Patel

· 2,593 Views · 1 Like

Capturing Acknowledgement in Kafka Streaming With RecordMetadata

In this article, explore RecordMetadata, and its attributes, and discover how it can be leveraged using various use cases.

May 24, 2024

by Raja Chattopadhyay

· 4,288 Views · 2 Likes

AWS: EC2 User Data vs. EC2 AMI

A comparison study among two EC2 initialization/configuration tools — User Data and AMI, which help in the configuration and management of EC2 instances.

May 24, 2024

by PRAVEEN SUNDAR

· 1,596 Views · 1 Like

Middleware in Autonomous Vehicles

Self-driving cars are becoming common; however, software development outside of ML topics is not well known. This post demystifies middleware for vehicles.

May 23, 2024

by Shobhit Kukreti

· 3,526 Views · 3 Likes

The Latest Data Engineering Topics