Data Engineering Resources

The Data (Pipeline) Movement: A Guide to Real-Time Data Streaming and Future Proofing Through AI Automation and Vector Databases

Dive into the essential strategies for leveraging real-time data streaming, AI automation, and vector databases to drive actionable insights.

November 7, 2024

by Tuhin Chattopadhyay

CORE

· 2,358 Views · 3 Likes

Designing Scalable and Secure Cloud-Native Architectures: Technical Strategies and Best Practices

Explore the flexibility, scalability, and efficiency of cloud-native architecture compared to monolithic architecture, and learn the challenges of implementing.

November 6, 2024

by Roman Shmyhelskyi

· 15,718 Views · 65 Likes

Model Compression: Improving Efficiency of Deep Learning Models

Model compression is a key component of real-time deployment of deep learning models. This article explores different approaches to make models more efficient.

November 6, 2024

by Inderjot Singh Saggu

· 1,334 Views · 6 Likes

Making Sense of Open-Source Vulnerability Databases: NVD, OSV, and More

Explore this essential reading for devs and security professionals alike: a comprehensive comparison of vulnerability databases to help cut through the noise.

November 6, 2024

by C.J. May

· 644 Views · 1 Like

Building Scalable AI-Driven Microservices With Kubernetes and Kafka

AI microservices, Kubernetes, and Kafka enable scalable, resilient intelligent applications through modular architecture and efficient resource management.

November 6, 2024

by Dileep Kumar Pandiya

· 4,531 Views · 3 Likes

Integrated Gradients: AI Explainability for Regulated Industries

Learn how Integrated Gradients helps identify which input features contribute most to the model's predictions to ensure transparency.

November 6, 2024

by Vamsi Kavuri

CORE

· 752 Views · 3 Likes

How Jenkins Can Stay Relevant in the Next Decade

Explore some thoughts about how Jenkins will remain relevant in the next decade, still delivering excellent value for CI/CD pipelines.

November 6, 2024

by Vishal Raina

· 4,291 Views · 7 Likes

Leveraging Apache Flink Dashboard for Real-Time Data Processing in AWS Apache Flink Managed Service

Find out how to utilize the Apache Flink Dashboard for monitoring, optimizing, and managing real-time data processing applications within AWS-managed services.

November 6, 2024

by Sneha Murganoor

· 25,707 Views · 7 Likes

Using SingleStore and WebAssembly for Sentiment Analysis of Stack Overflow Comments

In this article, learn how to use SingleStore and WebAssembly to perform sentiment analysis of Stack Overflow comments.

November 6, 2024

by Akmal Chaudhri

CORE

· 11,282 Views · 2 Likes

Real-Time Data Streaming on Cloud Platforms: Leveraging Cloud Features for Real-Time Insights

Explore the key aspects of real-time data streaming and analytics on cloud platforms, including architectures, integration strategies, and future trends.

November 6, 2024

by Sreenath Devineni

CORE

· 13,064 Views · 3 Likes

Cost Optimization Strategies for Managing Large-Scale Open-Source Databases

Explore some options that can be adapted to achieve effective management of large-scale open-source databases while keeping the costs in control.

November 5, 2024

by arvind toorpu

· 14,364 Views · 3 Likes

Build Retrieval-Augmented Generation (RAG) With Milvus

Learn to manage hallucinations by building RAGs with Milvus. Developers can embed similarity searches and use unstructured data for LLMs.

November 5, 2024

by Ifeanyi Benny Iheagwara

· 11,768 Views · 2 Likes

Harnessing GenAI for Enhanced Agility and Efficiency During Planning Phase

Learn how GenAI revolutionizes PI Planning by improving decision-making, tracking, and communication, driving more efficient and agile execution across teams.

November 5, 2024

by Yogesh Rathod

· 11,396 Views · 4 Likes

Licenses With Daily Time Fencing

Flexible licensing strategies not only attract new customers but help ISVs implement eco-design, too. Licenses with daily time fencing are more cost-effective.

November 5, 2024

by Arvind Bharti

· 11,943 Views · 3 Likes

How to Read JSON Files in Java Using the Google Gson Library

This tutorial blog focuses on teaching how to read the JSON files using the Google Gson library with different sample JSON files.

November 5, 2024

by Faisal Khatri

CORE

· 14,685 Views · 5 Likes

Two-Pass Huffman in Blocks of 2 Symbols: Golang Implementation

One of the most famous compression algorithms is Huffman coding. Here, see an advanced version: a block-based, 2-symbol, two-pass Huffman algorithm in Golang.

November 5, 2024

by Daniil Koshelev

· 9,350 Views · 4 Likes

Optimizing Your Data Pipeline: Choosing the Right Approach for Efficient Data Handling and Transformation Through ETL and ELT

ETL and ELT are vital for data integration and accessibility. Learn how to select the right approach based on your infrastructure, data volume, data complexity, and more.

November 5, 2024

by Ebere Oyekwe

· 14,014 Views · 3 Likes

Understanding Distributed System Performance… From the Grocery Store

Learn essential steps for boosting distributed system performance, explained with 7 lessons learned from grocery store checkout analogies.

November 4, 2024

by Felipe Mendes

· 13,076 Views · 2 Likes

How to Protect Yourself From the Inevitable GenAI Crash

GenAI has a case of the "shiny things" syndrome. Is a GenAI crash inevitable? Explore an experienced take in this article.

November 4, 2024

by Jason Bloomberg

· 10,933 Views · 6 Likes

The Modern Era of Data Orchestration: From Data Fragmentation to Collaboration

By embracing composability, organizations can position themselves to simplify governance and benefit from the greatest advances happening in our industry.

November 4, 2024

by Joel Lubinitsky

· 13,604 Views · 6 Likes

The Latest Data Engineering Topics