Data Engineering Resources

Building Scalable AI-Driven Microservices With Kubernetes and Kafka

AI microservices, Kubernetes, and Kafka enable scalable, resilient intelligent applications through modular architecture and efficient resource management.

November 6, 2024

by Dileep Kumar Pandiya

· 6,346 Views · 4 Likes

Integrated Gradients: AI Explainability for Regulated Industries

Learn how Integrated Gradients helps identify which input features contribute most to the model's predictions to ensure transparency.

November 6, 2024

by Vamsi Kavuri

CORE

· 20,601 Views · 5 Likes

How Jenkins Can Stay Relevant in the Next Decade

Explore some thoughts about how Jenkins will remain relevant in the next decade, still delivering excellent value for CI/CD pipelines.

November 6, 2024

by Vishal Raina

· 5,636 Views · 7 Likes

Leveraging Apache Flink Dashboard for Real-Time Data Processing in AWS Apache Flink Managed Service

Find out how to utilize the Apache Flink Dashboard for monitoring, optimizing, and managing real-time data processing applications within AWS-managed services.

November 6, 2024

by Sneha Murganoor

· 27,869 Views · 7 Likes

Using SingleStore and WebAssembly for Sentiment Analysis of Stack Overflow Comments

In this article, learn how to use SingleStore and WebAssembly to perform sentiment analysis of Stack Overflow comments.

November 6, 2024

by Akmal Chaudhri

CORE

· 11,694 Views · 3 Likes

Real-Time Data Streaming on Cloud Platforms: Leveraging Cloud Features for Real-Time Insights

Explore the key aspects of real-time data streaming and analytics on cloud platforms, including architectures, integration strategies, and future trends.

November 6, 2024

by Sreenath Devineni

CORE

· 16,156 Views · 4 Likes

Cost Optimization Strategies for Managing Large-Scale Open-Source Databases

Explore some options that can be adapted to achieve effective management of large-scale open-source databases while keeping the costs in control.

November 5, 2024

by arvind toorpu

CORE

· 15,711 Views · 5 Likes

Build Retrieval-Augmented Generation (RAG) With Milvus

Learn to manage hallucinations by building RAGs with Milvus. Developers can embed similarity searches and use unstructured data for LLMs.

November 5, 2024

by Ifeanyi Benny Iheagwara

· 13,263 Views · 2 Likes

Harnessing GenAI for Enhanced Agility and Efficiency During Planning Phase

Learn how GenAI revolutionizes PI Planning by improving decision-making, tracking, and communication, driving more efficient and agile execution across teams.

November 5, 2024

by Yogesh Rathod

· 12,304 Views · 4 Likes

Licenses With Daily Time Fencing

Flexible licensing strategies not only attract new customers but help ISVs implement eco-design, too. Licenses with daily time fencing are more cost-effective.

November 5, 2024

by Arvind Bharti

· 12,693 Views · 3 Likes

How to Read JSON Files in Java Using the Google Gson Library

This tutorial blog focuses on teaching how to read the JSON files using the Google Gson library with different sample JSON files.

November 5, 2024

by Faisal Khatri

CORE

· 18,303 Views · 6 Likes

Two-Pass Huffman in Blocks of 2 Symbols: Golang Implementation

One of the most famous compression algorithms is Huffman coding. Here, see an advanced version: a block-based, 2-symbol, two-pass Huffman algorithm in Golang.

November 5, 2024

by Daniil Koshelev

· 10,273 Views · 5 Likes

Optimizing Your Data Pipeline: Choosing the Right Approach for Efficient Data Handling and Transformation Through ETL and ELT

ETL and ELT are vital for data integration and accessibility. Learn how to select the right approach based on your infrastructure, data volume, data complexity, and more.

November 5, 2024

by Ebere Oyekwe

· 15,548 Views · 4 Likes

Understanding Distributed System Performance… From the Grocery Store

Learn essential steps for boosting distributed system performance, explained with 7 lessons learned from grocery store checkout analogies.

November 4, 2024

by Felipe Mendes

· 13,578 Views · 3 Likes

How to Protect Yourself From the Inevitable GenAI Crash

GenAI has a case of the "shiny things" syndrome. Is a GenAI crash inevitable? Explore an experienced take in this article.

November 4, 2024

by Jason Bloomberg

· 11,274 Views · 6 Likes

The Modern Era of Data Orchestration: From Data Fragmentation to Collaboration

By embracing composability, organizations can position themselves to simplify governance and benefit from the greatest advances happening in our industry.

November 4, 2024

by Joel Lubinitsky

· 14,991 Views · 6 Likes

Supporting Multiple Redis Databases With Infinispan Cache Aliases Enhancement

Learn how Infinispan cache aliases will help you replace your Redis Server with Infinispan for multiple Redis databases.

November 4, 2024

by Katia Aresti

· 13,087 Views · 4 Likes

AI-Powered Flashcard Application With Next.js, Clerk, Firebase, Material UI, and LLaMA 3.1

Create flashcards: Next.js for the front end, Clerk for user authentication, Firebase for storage, Material UI for an interface, and LLaMA 3.1 for generation.

November 4, 2024

by Vaibhavi Tiwari

· 15,768 Views · 7 Likes

Showing Long Animation Frames in Your DevTools

Use this code sample to integrate Long Animation Frames (LoAF) into the Chrome DevTools Performance Profiler to see where slow frames are happening quickly.

November 4, 2024

by Todd Gardner

· 13,637 Views · 4 Likes

Using Oracle Database 23AI for Generative AI RAG Implementation: Part 1

Explore the basics of vectors and embeddings, how the Oracle vector DB works, and develop a RAG application to enhance a local LLM.

November 4, 2024

by Shamim Bhuiyan

· 10,310 Views · 1 Like

The Latest Data Engineering Topics