Data Engineering Resources

Full-Stack Security Guide: Best Practices and Challenges of Securing Modern Applications

Explore essential strategies, techniques, and tools to secure modern applications at every layer and the best practices and challenges encountered in full-stack security.

August 31, 2024

by Josephine Eskaline Joyce

CORE

· 11,065 Views · 11 Likes

The Chaos of Mismatched Ord and PartialOrd Implementations in Rust's BTreeSet

Using a practical example, explore a crucial issue in Rust's BTreeSet: the impact of implementing Ord and PartialOrd traits differently for the same type.

August 30, 2024

by Dursun Koç

CORE

· 3,669 Views · 2 Likes

Snowflake Administration: A Comprehensive Step-by-Step Guide

Managing Snowflake involves overseeing various tasks to ensure optimal performance, security, and data integrity.

August 30, 2024

by Harshavardhan Yedla

· 10,983 Views · 2 Likes

The Enterprise Guide to Cloud Security Posture Management

Learn how to streamline security operations and empower IT teams to proactively protect cloud infrastructure with CSPM solutions.

August 30, 2024

by Sudip Sengupta

CORE

· 6,584 Views · 5 Likes

Day in the Life of a Developer With Google's Gemini Code Assist: Part 2

Conclude the review of Google Gemini Code Assist-enabled development in VS Studio Code and its impact on deployment and operations.

August 30, 2024

by Aakash Sharma

· 5,004 Views · 1 Like

Enhance Terraform Final Plan Output in GitHub Actions

Follow these tips to easily identify and confirm the exact cloud resource changes for your GitHub pipeline approvals.

August 30, 2024

by Karthigayan Devan

· 6,370 Views · 4 Likes

High Fidelity Data: Balancing Privacy and Usage

Explore High Fidelity (HiFi) Data features such as visual, population, statistical, and ownership integrity, and its use to balance privacy and usability.

August 29, 2024

by Zilong Tang

· 6,240 Views · 4 Likes

When (Not) to Write an Apache APISIX Plugin

This post aims to provide practical alternatives to writing a custom plugin, offering solutions you can quickly implement in your projects.

August 29, 2024

by Nicolas Fränkel

· 3,692 Views · 1 Like

Team-as-Code: How to Apply Platform Engineering to DevOps’ Coding Stage

Learn how secure Cloud Development Environments (CDEs) automate environment setup, personalize developer experiences, enforce security policies, and more.

August 29, 2024

by Laurent Balmelli, PhD

· 6,383 Views · 2 Likes

Utilizing Multiple Vectors and Advanced Search Data Model Design for City Data

Learn how to build, architect, and design complex unstructured data applications for vector databases utilizing Milvus, GenAI, LangChain, YoLo, and more.

August 29, 2024

by Tim Spann

CORE

· 6,821 Views · 4 Likes

The Ultimate Guide to Evaluate RAG System Components: What You Need to Know

The RAG system contains two core components: the retriever and the generator. This article introduces how to evaluate these two components.

August 29, 2024

by Usama Jamil

· 3,421 Views · 4 Likes

Java Concurrency: Visibility and Synchronized

In this post, gain insight into variable visibility between two threads and what happens when we change a variable that is shared.

August 28, 2024

by Emmanouil Gkatziouras

CORE

· 9,987 Views · 6 Likes

Advanced Techniques in Automated Threat Detection

Explore advanced automated threat detection using AI and machine learning to combat evolving cyber threats, streamline security, and enhance protection.

August 28, 2024

by Anastasios Arampatzis

· 5,058 Views · 1 Like

The Evolution of Conversational AI: Blending Determinism With Dynamism

Learn how the future of conversational AI lies in the seamless integration of deterministic workflows and dynamic, creative responses.

August 28, 2024

by Xavier Portilla Edo

CORE

· 5,090 Views · 2 Likes

Why Replace External Database Caches?

Although external caches are a great companion for reducing latencies, they often introduce more problems than benefits. Learn more in this post.

August 28, 2024

by Felipe Mendes

· 5,853 Views · 3 Likes

Documenting a Java WebSocket API Using Smart-Doc

This article will detail how to use Smart-Doc to generate Java WebSocket interface documentation and provide a complete example of a WebSocket server.

August 28, 2024

by sun yu

· 8,366 Views · 3 Likes

Effortless Concurrency: Leveraging the Actor Model in Financial Transaction Systems

Learn challenges of financial transaction systems and implement robust mechanisms to handle concurrency effectively to ensure system integrity and reliability.

August 28, 2024

by Nikita Melnikov

· 32,746 Views · 6 Likes

Enhancing Accuracy in AI-Driven Mobile Applications: Tackling Hallucinations in Large Language Models

LLMs often hallucinate, leading to inaccurate responses. Contextualization and integrating knowledge bases can significantly reduce these errors.

August 27, 2024

by Nakul Pandey

· 3,521 Views · 1 Like

Are You Tired of Fragile Tests? Meet data-testid

Explore the data-testid attribute, which is specifically designed for testing purposes, and offers numerous advantages, particularly from a QA perspective.

August 27, 2024

by Shivam Bharadwaj

· 4,329 Views · 3 Likes

Building a Powerful AI and Machine Learning Pipeline: Best Practices and Tools

Explore best practices and steps for constructing a robust AI/ML pipeline, from data collection and processing to model deployment and monitoring.

August 27, 2024

by Kishorebabu Tenneti

· 4,268 Views · 2 Likes

The Latest Data Engineering Topics