Data Engineering Resources

Navigating the Regulatory Maze: Simplifying Data Compliance

Explore how IT professionals can address evolving regulatory compliance challenges in data management, reducing organizational risks and costs.

September 20, 2024

by Tom Smith

CORE

· 4,549 Views · 1 Like

Open Source .NET Aspire and Dapr: What Are They and How Do They Complement Each Other For Distributed Apps?

This article covers both .NET Aspire and Dapr, the problems they solve, their differences, and why .NET developers should use them together.

September 20, 2024

by Marc Duiker

· 4,336 Views · 3 Likes

Observability With eBPF

Take an in-depth look at eBPF, a technology that allows you to run sandboxed programs within the Linux kernel.

September 19, 2024

by Kranthi Kiran Erusu

· 11,623 Views · 7 Likes

Battle of the RabbitMQ Queues: Performance Insights on Classic and Quorum

When deciding between RabbitMQ’s Classic and Quorum queues, it’s important to recognize that both have their strengths and weaknesses. Learn more here.

September 19, 2024

by Josephine Eskaline Joyce

CORE

· 20,382 Views · 9 Likes

Predicting Traffic Volume With Artificial Intelligence and Machine Learning

Explore the potential of random forest models in traffic forecasting and insights for future research aimed at improving urban traffic management systems.

September 19, 2024

by Aadi Jewargi

· 6,193 Views · 3 Likes

Enhancing Few-Shot Text Classification With Noisy Channel Language Model Prompting

Explore noisy channel language model prompting: few-shot text classification, enhancing stability, handling imbalanced data, and generalizing to unseen labels.

September 18, 2024

by Nakul Pandey

· 4,477 Views · 1 Like

Performing Advanced Facebook Event Data Analysis With a Vector Database

Learn how MyScale enhances event data analysis with Apify to scrape and analyze Facebook event data, offering semantic search capabilities for better insights.

September 18, 2024

by Usama Jamil

· 2,949 Views · 2 Likes

Optimizing Cost and Carbon Footprint With Smart Scaling Using SQS Queue Triggers: Part 1

Dynamic scaling with Amazon SQS and AWS Auto Scaling optimizes costs and energy use, enhancing sustainability and efficiency in cloud environments.

September 18, 2024

by Varun Dixit

· 51,659 Views · 3 Likes

Kafka Message Testing

Utilizing tools like RecordCaptor, as well as adhering to isolation principles and clear separation of test stages, ensures high accuracy and efficiency.

September 18, 2024

by Anton Belyaev

· 4,766 Views · 10 Likes

Securing Your Enterprise With an Identity-First Security Strategy

Cyberattacks are becoming increasingly sophisticated. Learn how an identity-first security strategy can tackle the evolving cyber threats in an AI-first-world.

September 18, 2024

by Vijay Pitchumani

· 4,270 Views · 2 Likes

Common Mistakes While Implementing Self-Recursive Calls in MuleSoft [Video]

In this article, discover the common mistakes developers make while making self-recursive calls and suggest best practices around them.

September 18, 2024

by Sravanthi Bhaskara

· 5,090 Views · 2 Likes

Zero to AI Hero, Part 4: Harness Local Language Models With Semantic Kernel; Your AI, Your Rules

Explore how to harness local language models with Semantic Kernel. Discover the power of running AI on your terms — secure, private, and under your control.

September 18, 2024

by Aneesh Gopalakrishnan

· 3,614 Views · 1 Like

AI and Technical Debt: Balancing Innovation and Sustainability

Learn how to navigate technical debt in AI projects, balance rapid adoption with long-term sustainability, and implement best practices for successful AI initiatives.

September 17, 2024

by Tom Smith

CORE

· 5,090 Views · 3 Likes

Troubleshooting PostgreSQL Low Free Memory

Gain an understanding of how databases (specifically PostgreSQL) manage memory and how to troubleshoot low free-memory scenarios.

September 17, 2024

by Adam Furmanek

CORE

· 5,867 Views · 7 Likes

Explore how to master high-load systems with custom solutions, caching, scalable architecture, and continuous optimization to handle millions of users.

September 17, 2024

by Alexander Kolobov

· 20,914 Views · 65 Likes

Algorithmic Advances in AI-Driven Search: Optimizing Query Processing for Precision and Speed

Explore concepts of AI-driven query processing, key algorithms that enhance search performance, and best practices for optimizing AI-powered retrieval systems.

September 17, 2024

by Lav Kumar

· 3,638 Views · 2 Likes

Database Keys: A Comprehensive Guide

Database keys are crucial for organizing and retrieving data efficiently. This guide provides a quick rundown of the main types.

September 17, 2024

by Brij kishore Pandey

· 6,182 Views · 1 Like

A Hands-On Guide to OpenTelemetry: Manual Instrumentation for Developers

This article continues the series by explaining how to manually instrument your application's telemetry data on your observability journey.

September 17, 2024

by Eric D. Schabell

CORE

· 4,428 Views · 3 Likes

Commonly Occurring Errors in Microsoft Graph Integrations and How To Troubleshoot Them (Part 6)

Explore an example to change a column value for a list item of a “user-defined” SharePoint list using a DriveItem, which also represents the PDF file.

September 16, 2024

by Constantin Kwiatkowski

· 4,009 Views · 1 Like

Observability Agent Architecture

Explore these practices to build efficient, trustworthy, and safe software agents to provide observability for customer applications.

September 16, 2024

by Kranthi Kiran Erusu

· 9,531 Views · 6 Likes

The Latest Data Engineering Topics