Data Engineering Resources

Beyond A/B Testing: How Multi-Armed Bandits Can Scale Complex Experimentation in Enterprise

Multi-armed bandits (MAB) is a powerful alternative that can scale complex experimentation in enterprises by dynamically balancing exploration and exploitation.

June 5, 2024

by Sapan Patel

· 2,827 Views · 1 Like

How To Build a Shopping Cart AI Chatbot

In this article, I show how to use Magic's Low-Code features to build an AI-based shopping cart for an online e-commerce store.

June 5, 2024

by Thomas Hansen

CORE

· 2,481 Views · 2 Likes

Add Flexibility to Your RAG Applications in Amazon Bedrock

Knowledge Bases for Amazon Bedrock is a fully managed capability that helps you implement the entire RAG workflow from ingestion to retrieval and prompt augmentation.

June 5, 2024

by Abhishek Gupta

CORE

· 3,237 Views · 1 Like

Take Your First Steps for Building on LLMs With Google Gemini

Learn to build an LLM application using the Google Gemini API and deploy it to Heroku. This guide walks you through setup, code, and deployment step-by-step.

June 5, 2024

by Alvin Lee

CORE

· 4,552 Views · 2 Likes

How To Perform Data Migration in MongoDB Using Node.js

Explore effective MongoDB data migration methods using Node.js, including manual migration, MongoDB drivers, and the Mongoose library.

June 5, 2024

by Sanjay Singhania

· 3,453 Views · 1 Like

Optimizing Cloud Spend in the New Era: Strategies and Frameworks for Cost Management

Effective cloud cost management is not just about cutting costs but also about optimizing cloud usage in a way that aligns with organizational goals and strategies.

June 5, 2024

by Marija Naumovska

CORE

· 3,068 Views · 1 Like

Protecting PII Data With JWT

Use JWT tokens for fine-grained access control while avoiding direct inclusion of PII-like account numbers. Use non-PII identifiers and perform server-side lookup.

June 5, 2024

by Abhishek Goswami

· 2,770 Views · 2 Likes

I Built a Reusable Dashboard for Read the Docs Traffic Analytics Using Vizro-AI

This article explores a simple, low code, and open-source solution to build a dashboard to visualize traffic data for documentation.

June 4, 2024

by Jo Stichbury

CORE

· 2,124 Views · 1 Like

LLMs Get a Memory Boost with HippoRAG

HippoRAG, a new RAG framework, uses a knowledge graph to represent connections between concepts, enabling LLMs to reason and provide more accurate, nuanced answers.

June 4, 2024

by Indrajit Bhattacharya

· 2,392 Views · 1 Like

Efficiently Transforming JDBC Query Results to JSON

Buffering query results introduces overhead and delay. Use the Pipe class provided by the Kilo framework to stream them instead!

June 4, 2024

by Greg Brown

· 1,949 Views · 1 Like

What Is Reverse ETL? Overview, Use Cases, and Key Benefits

Looking to go beyond traditional analytics? Reverse ETL is a nuanced process for businesses aiming to leverage data warehouses and other data platforms.

June 4, 2024

by Suhas Jangoan

· 5,181 Views · 2 Likes

New Ways for CNAPP to Shift Left and Shield Right: The Technology Trends That Will Allow CNAPP to Address More Extensive Threat Models

Because of the evolving threat landscape and complexity of modern organizations, the evolution of the CNAPP model yields both significant challenges and opportunities.

June 4, 2024

by Laurent Balmelli, PhD

· 2,854 Views · 1 Like

What Is ElastiCache Serverless?

This interview provides comprehensive answers about Amazon ElastiCache Serverless service, why it is needed, and when it is best to use it.

June 3, 2024

by Pavlo Konobeyev

· 3,497 Views · 2 Likes

Enhancing Vehicle Routing Problems With Deep Reinforcement Learning and Metaheuristics

Combining machine learning methods and traditional optimization techniques for logistics and fleet management execution optimizations.

June 3, 2024

by Sumit Mittal

· 3,287 Views · 2 Likes

Navigating the AI and Machine Learning Landscape: Insights From Indicium’s CDO

Indicium CDO Daniel Avancini shares insights on navigating the AI/ML landscape, from challenges and best practices to emerging trends.

June 3, 2024

by Tom Smith

CORE

· 1,915 Views · 1 Like

A Complete Guide To Implementing GraphQL for Java

This comprehensive guide is a valuable resource for Java developers seeking to create robust and efficient GraphQL API servers.

June 3, 2024

by David Ventimiglia

· 7,890 Views · 7 Likes

Hibernate Validator vs Regex vs Manual Validation: Which One Is Faster?

Inspired by coding for a performance backend competition, this article follows a test to find the fastest validator for Java applications.

June 3, 2024

by Fernando Boaglio

· 7,107 Views · 1 Like

High-Performance Storage Solutions

Pairing PostgreSQL with fast storage solutions is crucial for optimizing performance, minimizing downtime, and ensuring seamless data access.

June 3, 2024

by Sergey Platonov

· 2,003 Views · 3 Likes

An Overview of Data Pipeline Architecture

Dive into how a data pipeline helps process enormous amounts of data, key components, various architecture options, and best practices for maximum benefits.

Updated June 3, 2024

by Sreenath Devineni

· 13,593 Views · 5 Likes

Master the Art of Querying Data on Amazon S3

This article covers the importance of querying data stored on Amazon S3 and introduces three tools provided by AWS - Glue Crawler, Athena, and Redshift Spectrum.

June 3, 2024

by Satrajit Basu

CORE

· 3,632 Views · 1 Like

The Latest Data Engineering Topics