Data Engineering Resources

In-Depth Understanding of Vector Search for RAG and Generative AI Applications

Learn how to enhance LLMs with RAG using vector-based search and embeddings for more accurate responses, featuring tools like Azure AI Search.

August 20, 2024

by Mohammed Talib

· 9,445 Views · 7 Likes

Beyond Static Pipelines: Enhancing AI Agents With LlamaIndex

Build an AI agent using both a Query Engine Tool and a Function Tool of LlamaIndex to demonstrate how these tools can be integrated and utilized effectively.

August 20, 2024

by Usama Jamil

· 3,566 Views · 1 Like

Construct Azure Shared Access Signature URL to Download File From Azure Blob Storage

Learn how to construct an Azure Shared Access Signature URL to download a particular file from the Azure Blob Storage container.

August 20, 2024

by Chaitanya Kapure

· 6,241 Views · 1 Like

How to Decide Between Relational and Non-Relational Databases for the Project

This comprehensive comparison of relational vs non-relational databases examines their core aspects, key advantages and disadvantages, and typical use cases.

August 19, 2024

by Victor Osetskyi

· 5,268 Views · 4 Likes

Building Secure AI LLM APIs: A DevOps Approach to Preventing Data Breaches

Learn how DevOps is crucial for securing AI LLM APIs through practices like strong authentication, encryption, rate limiting, and continuous monitoring.

August 19, 2024

by Anton Lucanus

CORE

· 5,541 Views · 1 Like

Custom Elements Manifest: The Key to Seamless Web Component Discovery and Documentation

Discover the role of Custom Elements Manifest in seamless web component integration for documentation and beyond.

August 19, 2024

by Pradeep kumar Saraswathi

· 5,981 Views · 2 Likes

Cloud Build Unleashed: Expert Techniques for CI/CD Optimization

Discover strategies to enhance speed and efficiency and ensure that your deployments are secure, compliant, and resilient.

August 19, 2024

by Pavan Vemuri

CORE

· 9,833 Views · 9 Likes

Understanding PolyBase and External Stages: Making Informed Decisions for Data Querying

Explore the differences and strengths of PolyBase and Snowflake external tables to optimize data querying strategies and achieve efficient data integration.

August 19, 2024

by Harshavardhan Yedla

· 5,391 Views · 2 Likes

Data Security Solution for US Federal Customers

Explore what you need to do to cater security solutions to federal customers: data security; NIST, FIPS, FISMA, and FedRAMP certifications and regulations.

August 19, 2024

by Priyanka Neelakrishnan

· 7,933 Views · 1 Like

Benchmarking OpenAI Models for Automated Error Resolution

This article evaluates LLMs in software development, focusing on their effectiveness in resolving errors, a key task in software developers' workflows.

August 19, 2024

by Reilly Oldham

· 4,966 Views · 7 Likes

API Security: The Cornerstone of AI and LLM Protection

Explore how API security is integral to AI and LLM security and learn key strategies for developers and security teams.

August 19, 2024

by Tom Smith

CORE

· 3,565 Views · 1 Like

React Server Components (RSC): The Future of React

React Server Components (RSCs) bring a major performance boost to React by rendering components directly on the server and sending the HTML to the browser.

August 16, 2024

by Venkata Sai Manoj Pasupuleti

· 6,470 Views · 2 Likes

What Is SQL Injection and How Can It Be Avoided?

Learn about SQL Injection, a security risk in which the attackers find ways to manipulate inputs that are not cleaned properly in order to gain access to data.

August 16, 2024

by Manas Sadangi

· 6,937 Views · 2 Likes

Why AI-Assisted Code Generation Is Transforming Software Development

AI-assisted code generation is revolutionizing software development through its use of machine learning, which is significantly reducing development time and errors.

August 15, 2024

by Danny Logsdon

· 5,455 Views · 5 Likes

Tour of Snowflake Ingestion Using CockroachDB and Redpanda Connect

This is an exploratory article delving into various ways to ingest real-time data into Snowflake and the levels of difficulty and effort required.

August 15, 2024

by Artem Ervits

CORE

· 5,773 Views · 1 Like

Unboxing the Black Box

Explore explainable AI by unpacking heat maps and Structured Attention Graphs for explaining model decisions in computer vision applications.

August 15, 2024

by Anurag Paul

· 4,385 Views · 6 Likes

Revolutionizing Billing Processes With AI: Enhancing Efficiency and Accuracy

Discover how AI-driven billing systems are transforming revenue management by enhancing accuracy, efficiency, and customer satisfaction.

August 15, 2024

by Lohith Kumar Paripati

· 4,365 Views · 3 Likes

Large Language Models: Changing the Game in Software Development With Code Generation, Debugging, and CI/CD Integration

LLMs revolutionize software development by translating verbal instructions into executable code, enhancing productivity, and automating debugging processes.

August 15, 2024

by Suri (thammuio)

CORE

· 23,083 Views · 4 Likes

Data Pipeline vs. ETL Pipeline

Understand the key differences, use cases, and best practices for real-time data processing and batch data integration.

August 15, 2024

by Pier-Jean MALANDRINO

CORE

· 7,768 Views · 4 Likes

Essential Guidelines for Building Optimized ETL Data Pipelines in the Cloud With Azure Data Factory

Discover how to optimize Azure Data Factory pipelines by selecting the right activities and managing resources for reliable data processing.

August 14, 2024

by Aravind Nuthalapati

CORE

· 37,814 Views · 5 Likes

The Latest Data Engineering Topics