Data Engineering Resources

Scrape Amazon Product Reviews With Python

Let's learn how we can implement Python and Python scripts to scrape the Amazon website in an ethical way to extract product review data.

January 29, 2025

by Juveria dalvi

· 2,756 Views · 2 Likes

Implement RAG With PGVector, LangChain4j, and Ollama

Apply vector search and RAG experiments to enhance query results and optimize data storage for text embeddings, specifically with Bruce Springsteen's album data.

January 28, 2025

by Gunter Rotsaert

CORE

· 2,909 Views · 2 Likes

Using Spring AI to Generate Images With OpenAI's DALL-E 3

Integrate Spring AI with OpenAI's DALL-E 3 to generate images. Set up Spring Boot, configure the API integration, and customize settings easily.

January 28, 2025

by Danil Temnikov

CORE

· 10,814 Views · 12 Likes

Understanding Inference Time Compute

Inference time compute is a crucial factor in the deployment of machine learning models, where performance, efficiency, and user experience are key.

January 28, 2025

by Bhala Ranganathan

CORE

· 16,578 Views · 4 Likes

How Apache Flink and Apache Paimon Influence Data Streaming

Apache Flink is a crucial component of Apache Paimon since it offers the real-time processing power that enhances Paimon's strong consistency and storage features.

January 28, 2025

by Gautam Goswami

CORE

· 5,783 Views · 4 Likes

Vector Storage, Indexing, and Search With MariaDB

Since MariaDB 11.7, you can store vectors for generative AI applications in a single database. Learn more about these new features.

January 28, 2025

by Alejandro Duarte

CORE

· 46,843 Views · 5 Likes

Why Use AWS Lambda Layers? Advantages and Considerations

If you are not using layers for your AWS Lambda function, it's time to reconsider it. This article will give you a glimpse into the implementation of Lambda layers.

January 28, 2025

by Lior Shalom

CORE

· 6,244 Views · 1 Like

AWS Lambda Enhances Local IDE Experience With AI Support

Learn how to deploy code to AWS Lambda directly from Visual Studio using the AWS Toolkit for seamless development and testing.

January 27, 2025

by Anuj Tyagi

· 6,075 Views · 3 Likes

Working With Vision AI to Test Cloud Applications

Tricentis Tosca's Vision AI simplifies UI testing with mockup-based test creation, self-healing capabilities, and built-in accessibility checks for dynamic applications.

January 27, 2025

by John Vester

CORE

· 32,635 Views · 2 Likes

Get Started With Vector Search in Azure Cosmos DB

Learn how to enable and use vector search in Azure Cosmos DB for NoSQL with a step-by-step guide in Python, TypeScript, .NET, and Java using a movie dataset.

January 27, 2025

by Abhishek Gupta

CORE

· 4,695 Views · 2 Likes

Top Tools for Object Storage and Data Management

The best tools for object storage, including MinIO, Cyberduck, and more, to efficiently manage and store unstructured data in modern cloud environments.

January 27, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,466 Views · 5 Likes

Comparing SDLC With and Without AI/ML Integration

AI/ML integration in SDLC enhances efficiency, automation, and quality, surpassing traditional SDLC in scalability and adaptability to modern business needs.

January 27, 2025

by Chandrasekhar Rao Katru

· 5,180 Views · 9 Likes

Database Release and End-to-End Testing

A tech company that uses ClickHouse database cloning with JuiceFS for efficient end-to-end testing, improving data quality and consistency.

January 27, 2025

by Tao Ma

· 2,076 Views · 1 Like

CUI Document Identification and Classification

This article focuses on how developers can design and implement systems to identify, classify, and tag CUI documents using technical tools and frameworks.

January 27, 2025

by Prashant Kondle

· 2,279 Views

Integrating AI With Spring Boot: A Beginner’s Guide

In this guide, you will learn how to integrate AI into your Spring Boot app using Spring AI and simplify your AI setup with familiar Spring abstractions.

January 27, 2025

by Gunter Rotsaert

CORE

· 8,490 Views · 5 Likes

Best Practices for Evaluating LLMs and RAG Systems

Rigorous evaluation of LLM generation and retrieval systems drives robust, reliable, and ethical performance in RAG pipelines.

January 27, 2025

by Salman Khan

CORE

· 7,954 Views · 4 Likes

The Evolution of User Authentication With Generative AI

Modern authentication must evolve beyond CAPTCHAs as advancements in generative AI make traditional verification methods obsolete.

January 27, 2025

by Abhai Pratap Singh

· 5,318 Views · 3 Likes

CubeFS: High-Performance Storage for Cloud-Native Apps

CubeFS is a CNCF-graduated, cloud-native distributed file system delivering scalable performance, fault tolerance, and smooth Kubernetes integration.

January 24, 2025

by Sai Sandeep Ogety

CORE

· 7,730 Views · 8 Likes

Balancing Security and UX With Iterative Experimentation

Experimentation is essential for modern applications as it will allow you to adapt early and improve your product periodically for long-term success.

January 24, 2025

by Swapnil Patil

· 4,821 Views · 2 Likes

Accelerating HCM Cloud Implementation With RPA

Streamline HCM cloud implementation with RPA: automate data migration, MFA handling, role management, and UAT for faster, accurate, and secure deployments.

January 24, 2025

by Tarun Jain

· 4,253 Views · 1 Like

The Latest Data Engineering Topics