Data Engineering Resources

Setting Up a Data Warehouse for Starlight: A Comprehensive Guide

Learn architectural considerations, essential tools, and technologies, and see sample code snippets to illustrate key steps of a data warehouse setup.

September 5, 2024

by Harsh Daiya

CORE

· 4,482 Views · 2 Likes

Supercharging IaC With AI for Next-Gen Infrastructure Efficiency

This article explores some important areas where AI is reshaping IaC operations and discusses what the future may hold.

September 4, 2024

by Omry Hay

· 7,483 Views · 2 Likes

My Journey With AWS CDK and Java: What You Need To Know

Learn how Java is a very viable option when working with the AWS CDK, especially for workload teams already familiar with the language and its ecosystem.

September 4, 2024

by Jeroen Reijn

CORE

· 8,855 Views · 5 Likes

How to Conduct Effective Data Security Audits for Big Data Systems

Learn key strategies for conducting thorough data security audits in big data systems to safeguard sensitive information.

September 4, 2024

by Devin Partida

· 5,727 Views · 2 Likes

MLOps: How to Build a Toolkit to Boost AI Project Performance

AI projects could end up among the 90% that fail due to common implementation pitfalls. Here, learn how to change the game with the right MLOps tools.

September 3, 2024

by Alexander Simonov

· 7,629 Views · 5 Likes

How We Optimized Read Performance: Readahead, Prefetch, and Cache

In this in-depth analysis, take a deep dive into how JuiceFS enhances read performance using readahead, prefetch, and cache.

September 3, 2024

by Edric Mo

· 5,615 Views · 2 Likes

Automating Cucumber Data Table to Java Object Mapping in Your Cucumber Tests

Learn how to use the library cucumber-datatable-to-bean-mapping to simplify Data Table usage on your Cucumber tests.

September 3, 2024

by Thomas Deblock

· 9,291 Views · 4 Likes

Configuring a Connection Pool

A connection pooler is a software component that manages database connections. In this post, learn what a connection pooler is and how to configure it.

September 3, 2024

by Adam Furmanek

CORE

· 3,670 Views · 4 Likes

Open Standards for Data Lineage: OpenLineage for Batch and Streaming

Explores trends and efforts to provide an open standard with OpenLineage, and how data governance solutions help fulfill enterprise-wide data governance needs.

September 3, 2024

by Kai Wähner

CORE

· 6,814 Views · 2 Likes

Bridging the Gap: How Developers and Security Professionals Can Collaborate for Better Cybersecurity

Experts at Black Hat 2024 reveal how developers and security pros can collaborate better: from shifting left to embracing AI and prioritizing user experience.

September 3, 2024

by Tom Smith

CORE

· 5,542 Views · 1 Like

Confusion Matrix vs. ROC Curve: When to Use Which for Model Evaluation

The Confusion Matrix and the ROC Curve evaluate model performance in machine learning and data science. Compare and learn when to use each in model evaluation.

September 3, 2024

by Fizza Jatniwala

· 7,513 Views · 2 Likes

Workload Protection in the Cloud: Why It Matters More Than Ever

Protecting cloud workloads is crucial as threats evolve and environments become more complex. Learn about effective Cloud Workload Protection (CWP) here.

September 3, 2024

by Josephine Eskaline Joyce, Ph.D

CORE

· 5,119 Views · 4 Likes

From Zero to AI Hero, Part 1: Jumpstart Your Journey With Semantic Kernel

Follow the steps outlined in this multi-part series to start with Semantic Kernel and integrate intelligent, context-aware functionalities into your projects.

September 3, 2024

by Aneesh Gopalakrishnan

· 9,179 Views · 9 Likes

Telemetry Pipelines Workshop: Integrating Fluent Bit With OpenTelemetry, Part 2

Take a look at integrating Fluent Bit with OpenTelemetry for use cases where this connectivity in your telemetry data infrastructure is essential.

September 2, 2024

by Eric D. Schabell

CORE

· 7,067 Views · 3 Likes

Building Product to Learn AI, Part 3: Taste Testing and Evaluating

Before our AI meal planner is complete, one crucial step remains: a taste test. This is where a robust evaluation framework becomes your most valuable tool.

September 2, 2024

by Indrajit Bhattacharya

· 3,678 Views · 3 Likes

Best Practices for Salesforce Data Management and Security

Are you doing enough to ensure data security while adhering to data hygiene best practices? Here, learn Salesforce data management and security best practices.

September 2, 2024

by Ilya Dudkin

CORE

· 3,986 Views · 2 Likes

Zero Trust and Its Impact on Cybersecurity

With the rise of remote work and the dissolution of the traditional security perimeter, enterprises have shifted to a Zero-Trust model to improve security.

September 2, 2024

by Siri Varma Vegiraju

CORE

· 15,059 Views · 3 Likes

API-Led Example: MuleSoft

This article takes a look at API-led architecture using Mule4 APIs in order to give a clear understanding of the development process of an API-led approach.

September 2, 2024

by Ankur Bhuyan

· 5,061 Views · 2 Likes

Full-Stack Security Guide: Best Practices and Challenges of Securing Modern Applications

Explore essential strategies, techniques, and tools to secure modern applications at every layer and the best practices and challenges encountered in full-stack security.

August 31, 2024

by Josephine Eskaline Joyce, Ph.D

CORE

· 11,431 Views · 11 Likes

The Chaos of Mismatched Ord and PartialOrd Implementations in Rust's BTreeSet

Using a practical example, explore a crucial issue in Rust's BTreeSet: the impact of implementing Ord and PartialOrd traits differently for the same type.

August 30, 2024

by Dursun Koç

CORE

· 3,787 Views · 2 Likes

The Latest Data Engineering Topics