Data Engineering Resources

Unlock AI Power: Generate JSON With GPT-4 and Node.js for Ultimate App Integration

Discover how to effectively integrate OpenAI’s API with Node.js, generating JSON outputs that enhance app functionality and leverage advanced AI technology.

August 21, 2024

by Pradeep kumar Saraswathi

· 6,575 Views · 2 Likes

Preventing and Fixing Bad Data in Event Streams: Part 2

The techniques we use for dealing with bad data in event streams differ from those in the batch world. Here, learn more about overcoming bad data in streaming.

August 21, 2024

by Adam Bellemare

· 6,564 Views · 3 Likes

Four Essential Tips for Building a Robust REST API in Java

Enhance your Java REST API with consistent resource naming, maintainable versioning, robust security, and proper exception handling.

August 21, 2024

by Otavio Santana

CORE

· 14,296 Views · 10 Likes

Snowflake and dbt Integration to Enable Advanced Analytics

This guide describes how to leverage dbt and Snowflake to build high-quality data pipelines, focusing on data and analytics rather than on infrastructure.

August 20, 2024

by Rajesh Remala

· 4,654 Views · 2 Likes

OpenShift Data Foundation on IBM Cloud Using Terraform, Part 1: Deployment

Automated workloads often have difficulty in using CLI or UI way to deploy ODF. Explore the use of Terraform for deploying ODF which can be used for automation.

August 20, 2024

by Aayush Subramaniam

· 5,191 Views · 2 Likes

Mastering PUE for Unmatched Data Center Performance

PUE can make or break data center energy efficiency. Improving this figure will help your facility lower costs and become more sustainable.

August 20, 2024

by Emily Newton

· 4,625 Views · 1 Like

How Data Encryption Can Simplify Infrastructure Architecture

Learn how to leverage data encryption capabilities to improve security standards, simplify infrastructure architecture, and enhance developer velocity.

August 20, 2024

by Lulu Cheng

· 4,384 Views · 2 Likes

In-Depth Understanding of Vector Search for RAG and Generative AI Applications

Learn how to enhance LLMs with RAG using vector-based search and embeddings for more accurate responses, featuring tools like Azure AI Search.

August 20, 2024

by Mohammed Talib

· 9,192 Views · 7 Likes

Beyond Static Pipelines: Enhancing AI Agents With LlamaIndex

Build an AI agent using both a Query Engine Tool and a Function Tool of LlamaIndex to demonstrate how these tools can be integrated and utilized effectively.

August 20, 2024

by Usama Jamil

· 3,390 Views · 1 Like

Construct Azure Shared Access Signature URL to Download File From Azure Blob Storage

Learn how to construct an Azure Shared Access Signature URL to download a particular file from the Azure Blob Storage container.

August 20, 2024

by Chaitanya Kapure

· 6,118 Views · 1 Like

How to Decide Between Relational and Non-Relational Databases for the Project

This comprehensive comparison of relational vs non-relational databases examines their core aspects, key advantages and disadvantages, and typical use cases.

August 19, 2024

by Victor Osetskyi

· 5,162 Views · 4 Likes

Building Secure AI LLM APIs: A DevOps Approach to Preventing Data Breaches

Learn how DevOps is crucial for securing AI LLM APIs through practices like strong authentication, encryption, rate limiting, and continuous monitoring.

August 19, 2024

by Anton Lucanus

CORE

· 5,331 Views · 1 Like

Custom Elements Manifest: The Key to Seamless Web Component Discovery and Documentation

Discover the role of Custom Elements Manifest in seamless web component integration for documentation and beyond.

August 19, 2024

by Pradeep kumar Saraswathi

· 5,714 Views · 2 Likes

Cloud Build Unleashed: Expert Techniques for CI/CD Optimization

Discover strategies to enhance speed and efficiency and ensure that your deployments are secure, compliant, and resilient.

August 19, 2024

by Pavan Vemuri

CORE

· 9,576 Views · 9 Likes

Understanding PolyBase and External Stages: Making Informed Decisions for Data Querying

Explore the differences and strengths of PolyBase and Snowflake external tables to optimize data querying strategies and achieve efficient data integration.

August 19, 2024

by Harshavardhan Yedla

· 5,030 Views · 2 Likes

Data Security Solution for US Federal Customers

Explore what you need to do to cater security solutions to federal customers: data security; NIST, FIPS, FISMA, and FedRAMP certifications and regulations.

August 19, 2024

by Priyanka Neelakrishnan

· 7,777 Views · 1 Like

Benchmarking OpenAI Models for Automated Error Resolution

This article evaluates LLMs in software development, focusing on their effectiveness in resolving errors, a key task in software developers' workflows.

August 19, 2024

by Reilly Oldham

· 4,808 Views · 7 Likes

API Security: The Cornerstone of AI and LLM Protection

Explore how API security is integral to AI and LLM security and learn key strategies for developers and security teams.

August 19, 2024

by Tom Smith

CORE

· 3,345 Views · 1 Like

React Server Components (RSC): The Future of React

React Server Components (RSCs) bring a major performance boost to React by rendering components directly on the server and sending the HTML to the browser.

August 16, 2024

by Venkata Sai Manoj Pasupuleti

· 6,188 Views · 2 Likes

What Is SQL Injection and How Can It Be Avoided?

Learn about SQL Injection, a security risk in which the attackers find ways to manipulate inputs that are not cleaned properly in order to gain access to data.

August 16, 2024

by Manas Sadangi

· 6,627 Views · 2 Likes

The Latest Data Engineering Topics