Data Engineering Resources

Commonly Occurring Errors in Microsoft Graph Integrations and How To Troubleshoot Them (Part 7)

This article discusses retrieving attachments from various SharePoint lists using the SharePoint API and Microsoft Graph API.

January 30, 2025

by Constantin Kwiatkowski

· 4,703 Views

Scaling Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 30, 2025

by Ganapathy Subramanian Ramachandran

· 2,996 Views

Passing JSON Variables in Azure Pipelines

Learn how to handle JSON variables in Azure DevOps pipelines, avoid escaping issues, and ensure seamless API integration with proper normalization techniques.

January 29, 2025

by Mohammed Basil

· 8,420 Views · 2 Likes

Predicting Diabetes Types: A Deep Learning Approach

Machine learning analysis of diabetes in young Indians: Deep learning vs. XGBoost (64.75% vs. 74% accuracy) using health and lifestyle data.

January 29, 2025

by Aditya Karnam Gururaj Rao

· 3,369 Views · 1 Like

Metal and the Simulated Annealing Algorithm

The Simulated Annealing algorithm described in this article demonstrates its effectiveness as a powerful tool for finding optimal solutions to complex problems.

January 29, 2025

by Vitaly Kuznetsov (Ippolitov)

· 3,379 Views · 2 Likes

Expert Guide: How to Slash Cloud Cost in 2025

In this guide, we will zero in on high-impact tips for cloud cost optimization. Cost is still a hurdle as many companies onboard to cloud computing.

January 29, 2025

by Milavkumar Shah

· 5,932 Views · 1 Like

Gemini 2.0 Flash (Experimental): A Deep Dive for Developers

Gemini 2.0 Flash — In the blog, let us see the top 10 abilities of the LLM and how developers can utilize it to develop various applications.

January 29, 2025

by Akash Lomas

· 4,216 Views · 1 Like

Scrape Amazon Product Reviews With Python

Let's learn how we can implement Python and Python scripts to scrape the Amazon website in an ethical way to extract product review data.

January 29, 2025

by Juveria dalvi

· 2,932 Views · 2 Likes

Implement RAG With PGVector, LangChain4j, and Ollama

Apply vector search and RAG experiments to enhance query results and optimize data storage for text embeddings, specifically with Bruce Springsteen's album data.

January 28, 2025

by Gunter Rotsaert

CORE

· 3,221 Views · 2 Likes

Using Spring AI to Generate Images With OpenAI's DALL-E 3

Integrate Spring AI with OpenAI's DALL-E 3 to generate images. Set up Spring Boot, configure the API integration, and customize settings easily.

January 28, 2025

by Danil Temnikov

CORE

· 11,244 Views · 12 Likes

Understanding Inference Time Compute

Inference time compute is a crucial factor in the deployment of machine learning models, where performance, efficiency, and user experience are key.

January 28, 2025

by Bhala Ranganathan

CORE

· 17,804 Views · 4 Likes

How Apache Flink and Apache Paimon Influence Data Streaming

Apache Flink is a crucial component of Apache Paimon since it offers the real-time processing power that enhances Paimon's strong consistency and storage features.

January 28, 2025

by Gautam Goswami

CORE

· 6,048 Views · 5 Likes

Vector Storage, Indexing, and Search With MariaDB

Since MariaDB 11.7, you can store vectors for generative AI applications in a single database. Learn more about these new features.

January 28, 2025

by Alejandro Duarte

CORE

· 47,251 Views · 5 Likes

Why Use AWS Lambda Layers? Advantages and Considerations

If you are not using layers for your AWS Lambda function, it's time to reconsider it. This article will give you a glimpse into the implementation of Lambda layers.

January 28, 2025

by Lior Shalom

CORE

· 6,615 Views · 1 Like

AWS Lambda Enhances Local IDE Experience With AI Support

Learn how to deploy code to AWS Lambda directly from Visual Studio using the AWS Toolkit for seamless development and testing.

January 27, 2025

by Anuj Tyagi

· 6,286 Views · 3 Likes

Working With Vision AI to Test Cloud Applications

Tricentis Tosca's Vision AI simplifies UI testing with mockup-based test creation, self-healing capabilities, and built-in accessibility checks for dynamic applications.

January 27, 2025

by John Vester

CORE

· 32,973 Views · 2 Likes

Get Started With Vector Search in Azure Cosmos DB

Learn how to enable and use vector search in Azure Cosmos DB for NoSQL with a step-by-step guide in Python, TypeScript, .NET, and Java using a movie dataset.

January 27, 2025

by Abhishek Gupta

CORE

· 4,927 Views · 3 Likes

Top Tools for Object Storage and Data Management

The best tools for object storage, including MinIO, Cyberduck, and more, to efficiently manage and store unstructured data in modern cloud environments.

January 27, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 6,210 Views · 5 Likes

Comparing SDLC With and Without AI/ML Integration

AI/ML integration in SDLC enhances efficiency, automation, and quality, surpassing traditional SDLC in scalability and adaptability to modern business needs.

January 27, 2025

by Chandrasekhar Rao Katru

· 5,520 Views · 9 Likes

Database Release and End-to-End Testing

A tech company that uses ClickHouse database cloning with JuiceFS for efficient end-to-end testing, improving data quality and consistency.

January 27, 2025

by Tao Ma

· 2,186 Views · 1 Like

The Latest Data Engineering Topics