Data Engineering Resources

Bridging Graphviz and Cytoscape.js for Interactive Graphs

Making Graphviz static digraphs interactive and compatible with Cytoscape by converting DOT format graphs into Cytoscape JSON using Python.

January 30, 2025

by Puneet Malhotra

· 4,365 Views · 1 Like

SmartXML: An Alternative to XPath for Complex XML Files

We'll discuss SmartXML, an XPath alternative for parsing complex XML files, converting them to SQL, and loading the results into a database seamlessly.

January 30, 2025

by Luca Sanders

· 5,754 Views · 2 Likes

Commonly Occurring Errors in Microsoft Graph Integrations and How To Troubleshoot Them (Part 7)

This article discusses retrieving attachments from various SharePoint lists using the SharePoint API and Microsoft Graph API.

January 30, 2025

by Constantin Kwiatkowski

· 4,600 Views

Scaling Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 30, 2025

by Ganapathy Subramanian Ramachandran

· 2,873 Views

Passing JSON Variables in Azure Pipelines

Learn how to handle JSON variables in Azure DevOps pipelines, avoid escaping issues, and ensure seamless API integration with proper normalization techniques.

January 29, 2025

by Mohammed Basil

· 8,206 Views · 2 Likes

Predicting Diabetes Types: A Deep Learning Approach

Machine learning analysis of diabetes in young Indians: Deep learning vs. XGBoost (64.75% vs. 74% accuracy) using health and lifestyle data.

January 29, 2025

by Aditya Karnam Gururaj Rao

· 3,274 Views · 1 Like

Metal and the Simulated Annealing Algorithm

The Simulated Annealing algorithm described in this article demonstrates its effectiveness as a powerful tool for finding optimal solutions to complex problems.

January 29, 2025

by Vitaly Kuznetsov (Ippolitov)

· 3,265 Views · 2 Likes

Expert Guide: How to Slash Cloud Cost in 2025

In this guide, we will zero in on high-impact tips for cloud cost optimization. Cost is still a hurdle as many companies onboard to cloud computing.

January 29, 2025

by Milavkumar Shah

· 5,778 Views · 1 Like

Gemini 2.0 Flash (Experimental): A Deep Dive for Developers

Gemini 2.0 Flash — In the blog, let us see the top 10 abilities of the LLM and how developers can utilize it to develop various applications.

January 29, 2025

by Akash Lomas

· 4,083 Views · 1 Like

Scrape Amazon Product Reviews With Python

Let's learn how we can implement Python and Python scripts to scrape the Amazon website in an ethical way to extract product review data.

January 29, 2025

by Juveria dalvi

· 2,843 Views · 2 Likes

Implement RAG With PGVector, LangChain4j, and Ollama

Apply vector search and RAG experiments to enhance query results and optimize data storage for text embeddings, specifically with Bruce Springsteen's album data.

January 28, 2025

by Gunter Rotsaert

CORE

· 3,059 Views · 2 Likes

Using Spring AI to Generate Images With OpenAI's DALL-E 3

Integrate Spring AI with OpenAI's DALL-E 3 to generate images. Set up Spring Boot, configure the API integration, and customize settings easily.

January 28, 2025

by Danil Temnikov

CORE

· 11,042 Views · 12 Likes

Understanding Inference Time Compute

Inference time compute is a crucial factor in the deployment of machine learning models, where performance, efficiency, and user experience are key.

January 28, 2025

by Bhala Ranganathan

CORE

· 17,314 Views · 4 Likes

How Apache Flink and Apache Paimon Influence Data Streaming

Apache Flink is a crucial component of Apache Paimon since it offers the real-time processing power that enhances Paimon's strong consistency and storage features.

January 28, 2025

by Gautam Goswami

CORE

· 5,904 Views · 4 Likes

Vector Storage, Indexing, and Search With MariaDB

Since MariaDB 11.7, you can store vectors for generative AI applications in a single database. Learn more about these new features.

January 28, 2025

by Alejandro Duarte

CORE

· 47,060 Views · 5 Likes

Why Use AWS Lambda Layers? Advantages and Considerations

If you are not using layers for your AWS Lambda function, it's time to reconsider it. This article will give you a glimpse into the implementation of Lambda layers.

January 28, 2025

by Lior Shalom

CORE

· 6,437 Views · 1 Like

AWS Lambda Enhances Local IDE Experience With AI Support

Learn how to deploy code to AWS Lambda directly from Visual Studio using the AWS Toolkit for seamless development and testing.

January 27, 2025

by Anuj Tyagi

· 6,225 Views · 3 Likes

Working With Vision AI to Test Cloud Applications

Tricentis Tosca's Vision AI simplifies UI testing with mockup-based test creation, self-healing capabilities, and built-in accessibility checks for dynamic applications.

January 27, 2025

by John Vester

CORE

· 32,837 Views · 2 Likes

Get Started With Vector Search in Azure Cosmos DB

Learn how to enable and use vector search in Azure Cosmos DB for NoSQL with a step-by-step guide in Python, TypeScript, .NET, and Java using a movie dataset.

January 27, 2025

by Abhishek Gupta

CORE

· 4,838 Views · 2 Likes

Top Tools for Object Storage and Data Management

The best tools for object storage, including MinIO, Cyberduck, and more, to efficiently manage and store unstructured data in modern cloud environments.

January 27, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,871 Views · 5 Likes

The Latest Data Engineering Topics