Data Engineering Resources

Ditch Your Local Setup: Develop Apps in the Cloud With Project IDX

Start building web apps in the cloud with Project IDX! This guide explores the features of Google's cloud IDE and shows you how to create a new React project.

November 4, 2024

by Anujkumarsinh Donvir

CORE

· 14,204 Views · 8 Likes

Digitalization of Airport and Airlines With IoT and Data Streaming Using Kafka and Flink

Take an in-depth look at IoT and data streaming using Kafka and Flink at airports such as Schiphol AMS and airlines like Lufthansa and Cathay.

November 4, 2024

by Kai Wähner

CORE

· 10,833 Views · 3 Likes

Optimizing Vector Search Performance With Elasticsearch

Optimize vector search in Elasticsearch through dimensionality reduction, efficient indexing, and automated parameter tuning for faster, more accurate results.

November 4, 2024

by Venkata Gummadi

· 20,482 Views · 5 Likes

High-Performance Reactive REST API and Reactive DB Connection Using Java Spring Boot WebFlux R2DBC Example

Find out how using Java Spring Boot WebFlux with R2DBC allows developers to build high-performance, reactive REST APIs with non-blocking database connections.

November 4, 2024

by Md Amran Hossain

CORE

· 19,253 Views · 5 Likes

What the CrowdStrike Crash Exposed About the Future of Software Testing

Leveraging automated software testing to mitigate costly failures in today’s fast-evolving and complex digital landscape.

November 1, 2024

by Mav Turner

· 12,115 Views · 2 Likes

Smart Routing Using AI for Efficient Logistics and Green Solutions

Investigate the role of AI in enhancing logistics efficiency and promoting environmental sustainability through advanced route optimization techniques.

November 1, 2024

by vuppulapati Chandra Sekhar Naidu

· 11,798 Views · 2 Likes

Data Governance Essentials: Glossaries, Catalogs, and Lineage (Part 5)

Discover how business glossaries, data catalogs, and data lineage work together to enhance data quality, compliance, transparency, and operational efficiency.

November 1, 2024

by Sukanya Konatam

· 14,373 Views · 3 Likes

Monitoring Kubernetes Service Topology Changes in Real Time

Stateful, distributed, containerized applications require real-time monitoring of cluster changes. Learn how EndpointSlices API provides a scalable solution.

November 1, 2024

by Udbhav Prasad

· 20,166 Views · 5 Likes

How to Identify Bottlenecks and Increase Copy Activity Throughput in Azure Data Factory

Learn how to optimize the throughput of a copy activity in Azure Data Factory by identifying bottlenecks, scaling integration runtimes, and more.

October 31, 2024

by Aravind Nuthalapati

CORE

· 40,412 Views · 3 Likes

Boosting Efficiency: Implementing Natural Language Processing With AWS RDS Using CloudFormation

See a comprehensive configuration of an NLP-enabled AWS RDS environment utilizing AWS CloudFormation templates and an in-depth cost and performance analysis.

October 31, 2024

by Vijay Panwar

CORE

· 10,434 Views · 1 Like

Exploring AI-Powered Web Development: OpenAI, Node.js, and Dynamic UI Creation

OpenAI API, Node.js, and JSON Schema combine to generate AI-driven UIs from prompts, validated by schema — transforming web development with consistent results.

October 31, 2024

by Pradeep kumar Saraswathi

· 5,276 Views · 3 Likes

Faster Startup With Spring Boot 3.2 and CRaC, Part 2

Continue with this series to learn how to overcome the two shortcomings of using automatic checkpoint and restore by performing the checkpoint on-demand.

October 31, 2024

by Magnus Larsson

· 14,073 Views · 5 Likes

Multimodal RAG Is Not Scary, Ghosts Are Scary

Run ghastly multimodal analytics and Retrieval Augmented Generation with our "ghosts" collections in the open-source Milvus vector database.

October 30, 2024

by Tim Spann

CORE

· 4,732 Views · 3 Likes

How to Get Plain Text From Common Documents in Java

Image-based documents require OCR for text extraction, but text-based documents don't. Here, learn ways to extract plain text from text-based documents.

October 30, 2024

by Brian O'Neill

CORE

· 8,489 Views · 6 Likes

Implementing LSM Trees in Golang: A Comprehensive Guide

Follow an implementation of an LSM tree in Golang, discuss features, and compare it with more traditional key-value storage systems and indexing strategies.

October 30, 2024

by Daniil Koshelev

· 14,209 Views · 7 Likes

Challenges and Ethical Considerations of AI in Team Management

AI is transforming team management by boosting efficiency and insights, but it brings challenges like privacy concerns, bias, and the risk of impersonal management.

October 30, 2024

by Nimit Gupta

· 6,701 Views · 3 Likes

Compliance Automated Standard Solution (COMPASS), Part 7: Compliance-to-Policy for IT Operation Policies Using Auditree

Implement the functionality of a CPAC for IT operations compliance that requires imperative policies with an example C2P plugin implementation for Auditree.

October 30, 2024

by Takumi Yanagawa

· 10,511 Views · 3 Likes

Hot Class Reload in Java: A Webpack HMR-Like Experience for Java Developers

Enhance your Java development with a hot class reload system, similar to Webpack's HMR. This guide explores using Java WatchService and the javax.tools API.

October 30, 2024

by Mohibul Hassan Chowdhury

· 5,386 Views · 4 Likes

How to Create a Pokémon Breeding Gaming Calculator Using HTML, CSS, and JavaScript

Follow this step-by-step guide to build an interactive Pokémon Breeding Calculator with code examples and tips (ideal for beginners and game developers).

October 30, 2024

by David Jones

· 7,429 Views · 1 Like

Snowflake Cortex Analyst: Unleashing the Power of Conversational AI for Text-to-SQL

Find out more about how conversational AI for text-to-SQL using Snowflake Cortex Analyst unlocks the potential for data-driven decision-making.

October 30, 2024

by Kapil Kumar Sharma

· 6,942 Views · 1 Like

The Latest Data Engineering Topics