Data Engineering Resources

Beyond Static Pipelines: Enhancing AI Agents With LlamaIndex

Build an AI agent using both a Query Engine Tool and a Function Tool of LlamaIndex to demonstrate how these tools can be integrated and utilized effectively.

August 20, 2024

by Usama Jamil

· 3,457 Views · 1 Like

Construct Azure Shared Access Signature URL to Download File From Azure Blob Storage

Learn how to construct an Azure Shared Access Signature URL to download a particular file from the Azure Blob Storage container.

August 20, 2024

by Chaitanya Kapure

· 6,176 Views · 1 Like

How to Decide Between Relational and Non-Relational Databases for the Project

This comprehensive comparison of relational vs non-relational databases examines their core aspects, key advantages and disadvantages, and typical use cases.

August 19, 2024

by Victor Osetskyi

· 5,207 Views · 4 Likes

Building Secure AI LLM APIs: A DevOps Approach to Preventing Data Breaches

Learn how DevOps is crucial for securing AI LLM APIs through practices like strong authentication, encryption, rate limiting, and continuous monitoring.

August 19, 2024

by Anton Lucanus

CORE

· 5,424 Views · 1 Like

Custom Elements Manifest: The Key to Seamless Web Component Discovery and Documentation

Discover the role of Custom Elements Manifest in seamless web component integration for documentation and beyond.

August 19, 2024

by Pradeep kumar Saraswathi

· 5,831 Views · 2 Likes

Cloud Build Unleashed: Expert Techniques for CI/CD Optimization

Discover strategies to enhance speed and efficiency and ensure that your deployments are secure, compliant, and resilient.

August 19, 2024

by Pavan Vemuri

CORE

· 9,668 Views · 9 Likes

Understanding PolyBase and External Stages: Making Informed Decisions for Data Querying

Explore the differences and strengths of PolyBase and Snowflake external tables to optimize data querying strategies and achieve efficient data integration.

August 19, 2024

by Harshavardhan Yedla

· 5,227 Views · 2 Likes

Data Security Solution for US Federal Customers

Explore what you need to do to cater security solutions to federal customers: data security; NIST, FIPS, FISMA, and FedRAMP certifications and regulations.

August 19, 2024

by Priyanka Neelakrishnan

· 7,844 Views · 1 Like

Benchmarking OpenAI Models for Automated Error Resolution

This article evaluates LLMs in software development, focusing on their effectiveness in resolving errors, a key task in software developers' workflows.

August 19, 2024

by Reilly Oldham

· 4,866 Views · 7 Likes

API Security: The Cornerstone of AI and LLM Protection

Explore how API security is integral to AI and LLM security and learn key strategies for developers and security teams.

August 19, 2024

by Tom Smith

CORE

· 3,447 Views · 1 Like

React Server Components (RSC): The Future of React

React Server Components (RSCs) bring a major performance boost to React by rendering components directly on the server and sending the HTML to the browser.

August 16, 2024

by Venkata Sai Manoj Pasupuleti

· 6,305 Views · 2 Likes

What Is SQL Injection and How Can It Be Avoided?

Learn about SQL Injection, a security risk in which the attackers find ways to manipulate inputs that are not cleaned properly in order to gain access to data.

August 16, 2024

by Manas Sadangi

· 6,737 Views · 2 Likes

Why AI-Assisted Code Generation Is Transforming Software Development

AI-assisted code generation is revolutionizing software development through its use of machine learning, which is significantly reducing development time and errors.

August 15, 2024

by Danny Logsdon

· 5,339 Views · 5 Likes

Tour of Snowflake Ingestion Using CockroachDB and Redpanda Connect

This is an exploratory article delving into various ways to ingest real-time data into Snowflake and the levels of difficulty and effort required.

August 15, 2024

by Artem Ervits

CORE

· 5,703 Views · 1 Like

Unboxing the Black Box

Explore explainable AI by unpacking heat maps and Structured Attention Graphs for explaining model decisions in computer vision applications.

August 15, 2024

by Anurag Paul

· 4,298 Views · 6 Likes

Revolutionizing Billing Processes With AI: Enhancing Efficiency and Accuracy

Discover how AI-driven billing systems are transforming revenue management by enhancing accuracy, efficiency, and customer satisfaction.

August 15, 2024

by Lohith Kumar Paripati

· 4,263 Views · 3 Likes

Large Language Models: Changing the Game in Software Development With Code Generation, Debugging, and CI/CD Integration

LLMs revolutionize software development by translating verbal instructions into executable code, enhancing productivity, and automating debugging processes.

August 15, 2024

by Suri (thammuio)

CORE

· 22,927 Views · 4 Likes

Data Pipeline vs. ETL Pipeline

Understand the key differences, use cases, and best practices for real-time data processing and batch data integration.

August 15, 2024

by Pier-Jean MALANDRINO

CORE

· 7,635 Views · 4 Likes

Essential Guidelines for Building Optimized ETL Data Pipelines in the Cloud With Azure Data Factory

Discover how to optimize Azure Data Factory pipelines by selecting the right activities and managing resources for reliable data processing.

August 14, 2024

by Aravind Nuthalapati

CORE

· 37,697 Views · 5 Likes

Safeguarding Democracy in the Digital Age: Insights from Day 1 at Black Hat 2024 and Las Vegas Officials

Explore global, national, and local cybersecurity challenges and their impact on democracy, with insights from Black Hat 2024 and Las Vegas officials.

August 14, 2024

by Tom Smith

CORE

· 4,460 Views · 1 Like

The Latest Data Engineering Topics