Data Engineering Resources

Metal and the Simulated Annealing Algorithm

The Simulated Annealing algorithm described in this article demonstrates its effectiveness as a powerful tool for finding optimal solutions to complex problems.

January 29, 2025

by Vitaly Kuznetsov (Ippolitov)

· 2,094 Views · 2 Likes

Expert Guide: How to Slash Cloud Cost in 2025

In this guide, we will zero in on high-impact tips for cloud cost optimization. Cost is still a hurdle as many companies onboard to cloud computing.

January 29, 2025

by Milavkumar Shah

· 3,649 Views · 1 Like

Gemini 2.0 Flash (Experimental): A Deep Dive for Developers

Gemini 2.0 Flash — In the blog, let us see the top 10 abilities of the LLM and how developers can utilize it to develop various applications.

January 29, 2025

by Akash Lomas

· 2,604 Views · 1 Like

Scrape Amazon Product Reviews With Python

Let's learn how we can implement Python and Python scripts to scrape the Amazon website in an ethical way to extract product review data.

January 29, 2025

by Juveria dalvi

· 1,895 Views · 1 Like

Implement RAG With PGVector, LangChain4j, and Ollama

Apply vector search and RAG experiments to enhance query results and optimize data storage for text embeddings, specifically with Bruce Springsteen's album data.

January 28, 2025

by Gunter Rotsaert

CORE

· 1,962 Views · 1 Like

Using Spring AI to Generate Images With OpenAI's DALL-E 3

Integrate Spring AI with OpenAI's DALL-E 3 to generate images. Set up Spring Boot, configure the API integration, and customize settings easily.

January 28, 2025

by Danil Temnikov

· 5,149 Views · 7 Likes

Understanding Inference Time Compute

Inference time compute is a crucial factor in the deployment of machine learning models, where performance, efficiency, and user experience are key.

January 28, 2025

by Bhala Ranganathan

· 3,955 Views · 1 Like

How Apache Flink and Apache Paimon Influence Data Streaming

Apache Flink is a crucial component of Apache Paimon since it offers the real-time processing power that enhances Paimon's strong consistency and storage features.

January 28, 2025

by Gautam Goswami

CORE

· 2,873 Views · 2 Likes

Vector Storage, Indexing, and Search With MariaDB

Since MariaDB 11.7, you can store vectors for generative AI applications in a single database. Learn more about these new features.

January 28, 2025

by Alejandro Duarte

CORE

· 8,923 Views · 3 Likes

Why Use AWS Lambda Layers? Advantages and Considerations

If you are not using layers for your AWS Lambda function, it's time to reconsider it. This article will give you a glimpse into the implementation of Lambda layers.

January 28, 2025

by Lior Shalom

CORE

· 3,884 Views · 1 Like

AWS Lambda Enhances Local IDE Experience With AI Support

Learn how to deploy code to AWS Lambda directly from Visual Studio using the AWS Toolkit for seamless development and testing.

January 27, 2025

by Swati Tyagi

· 4,777 Views · 2 Likes

Working With Vision AI to Test Cloud Applications

Tricentis Tosca's Vision AI simplifies UI testing with mockup-based test creation, self-healing capabilities, and built-in accessibility checks for dynamic applications.

January 27, 2025

by John Vester

CORE

· 17,529 Views

Get Started With Vector Search in Azure Cosmos DB

Learn how to enable and use vector search in Azure Cosmos DB for NoSQL with a step-by-step guide in Python, TypeScript, .NET, and Java using a movie dataset.

January 27, 2025

by Abhishek Gupta

CORE

· 3,087 Views · 2 Likes

Top Tools for Object Storage and Data Management

The best tools for object storage, including MinIO, Cyberduck, and more, to efficiently manage and store unstructured data in modern cloud environments.

January 27, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 2,875 Views · 4 Likes

Comparing SDLC With and Without AI/ML Integration

AI/ML integration in SDLC enhances efficiency, automation, and quality, surpassing traditional SDLC in scalability and adaptability to modern business needs.

January 27, 2025

by Chandrasekhar Rao Katru

· 2,908 Views · 2 Likes

Database Release and End-to-End Testing

A tech company that uses ClickHouse database cloning with JuiceFS for efficient end-to-end testing, improving data quality and consistency.

January 27, 2025

by Tao Ma

· 1,660 Views

CUI Document Identification and Classification

This article focuses on how developers can design and implement systems to identify, classify, and tag CUI documents using technical tools and frameworks.

January 27, 2025

by Prashant Kondle

· 1,668 Views

Integrating AI With Spring Boot: A Beginner’s Guide

In this guide, you will learn how to integrate AI into your Spring Boot app using Spring AI and simplify your AI setup with familiar Spring abstractions.

January 27, 2025

by Gunter Rotsaert

CORE

· 4,958 Views · 3 Likes

Evaluating LLMs and RAG Systems

Rigorous evaluation of LLM generation and retrieval systems drives robust, reliable, and ethical performance in RAG pipelines.

January 27, 2025

by Salman Khan

CORE

· 5,858 Views · 3 Likes

The Evolution of User Authentication With Generative AI

Modern authentication must evolve beyond CAPTCHAs as advancements in generative AI make traditional verification methods obsolete.

January 27, 2025

by Abhai Pratap Singh

· 3,505 Views · 3 Likes

The Latest Data Engineering Topics