Data Engineering Resources

How AI and Data Science in 2024 Will Shape Tomorrow's World

In 2024, AI and Data Science reshape healthcare, education, urban living, and business for efficiency and personalization.

December 29, 2023

by Manas Sadangi

· 6,268 Views · 3 Likes

Offline Data Pipeline Best Practices Part 2:Optimizing Airflow Job Parameters for Apache Hive

Discover how to optimize Apache Spark job configurations in Apache Airflow for cost-effective and efficient offline data pipelines.

December 29, 2023

by Mitesh Mangaonkar

· 6,122 Views · 4 Likes

Apache Doris Speeds Up Data Reporting, Tagging, and Data Lake Analytics

The user leverages the capabilities of Apache Doris in reporting, customer tagging, and data lake analytics and achieves high performance.

December 29, 2023

by Shirley H.

· 5,501 Views · 3 Likes

Cross-Pollination for Creativity Leveraging LLMs

Building a RAG application to leverage ideas from one field to another boosting creativity.

December 29, 2023

by Raghavan Muthuregunathan

· 4,997 Views · 1 Like

How To Use Artificial Intelligence to Optimize DevOps

AI pledges to transform DevOps by eliminating mistakes and errors while helping companies build self-learning and flexible systems.

December 28, 2023

by Chandra Shekhar

· 5,785 Views · 3 Likes

SQL Loader + Unix Script: Loading Multiple Data Files in Oracle DB Table

Explore the power of SQL Loader + Unix Script utility where multiple data files can be loaded by the SQL loader with automated shell scripts.

December 28, 2023

by ARINDAM GOSWAMI

· 7,285 Views · 8 Likes

Migrating From Lombok to Records in Java

Below article covers the process of migration from Lombok to Records.

December 28, 2023

by Fernando Boaglio

· 25,902 Views · 23 Likes

Unveiling the Power of Helidon 4: A Dive Into New Features

Helidon 4 introduces cutting-edge features for streamlined microservices development with newly released groundbreaking features.

December 28, 2023

by Andrei Tuchin

CORE

· 9,253 Views · 3 Likes

Quantum Coherence Unleashed: Illuminating AI Decision-Making Networks

Witness the synchronized quantum dance revolutionizing AI and discover the unseen threads of possibility in this groundbreaking exploration.

December 28, 2023

by Ayomide agarau

· 4,362 Views · 2 Likes

Transforming Telecom With AI/ML: A Deep Dive Into Smart Networks

AI and ML are transforming telecom, optimizing networks, enhancing customer experience, and detecting fraud.

December 28, 2023

by Ashok Gorantla

CORE

· 18,212 Views · 8 Likes

Optimizing Java Applications: Parallel Processing and Result Aggregation Techniques

This article highlights the focus on optimizing Java applications through the use of parallel processing and result aggregation techniques.

December 28, 2023

by Ahsan Shah

· 19,350 Views · 8 Likes

Beyond Murphy's Law

This article discusses a complementary or reciprocal aspect of Murphy's Law that I've often observed while working on large systems.

December 28, 2023

by Bertrand Florat

· 5,026 Views · 3 Likes

Top 10 Python Applications Transforming the Real World

In this article, we'll delve into Python's top ten real-world applications, exploring how it has transformed various domains.

December 28, 2023

by Madhuri Hammad

· 5,035 Views · 4 Likes

Unlocking Language Models With Powerful Prompts

Learn how to write effective prompts to unlock the full potential of large language models, enabling them to perform complex tasks.

December 28, 2023

by Amit Rai

· 4,439 Views · 5 Likes

Essential Skills for Modern Machine Learning Engineers: A Deep Dive

Machine learning experts often lack vital skills. This article explores ways to bridge these gaps and meet the evolving demands of the industry.

December 27, 2023

by Nikolai Babkin

· 58,617 Views · 96 Likes

How To Select the Right Vector Database for Your Enterprise GENERATIVE-AI Stack

We will explore the framework for choosing the correct Vector Database in an enterprise for building a GENERATIVE AI-based application.

December 27, 2023

by Suvoraj Biswas

· 7,253 Views · 3 Likes

Offline Data Pipeline Best Practices Part 1:Optimizing Airflow Job Parameters for Apache Hive

Optimize offline data pipeline with Apache Airflow and AWS EMR. Focus on cost-effective strategies and Hive job configurations to reduce computing costs.

December 27, 2023

by Mitesh Mangaonkar

· 6,566 Views · 3 Likes

Embracing GraphQL: A Paradigm Shift in API Development

Have you heard about GraphQL? Let's explore this article to understand why we should embrace GraphQL, a new API paradigm!

December 27, 2023

by Yilia Lin

· 4,167 Views · 1 Like

PostgresML: Extension That Turns PostgreSQL Into a Platform for AI Apps

Learn how to use the PostgresML extension for text translation, sentiment analysis, and other AI-related tasks within PostgreSQL.

December 27, 2023

by Denis Magda

CORE

· 7,272 Views · 3 Likes

Microservices Resilient Testing Framework

This article explores the key principles that form the foundation for MRTF and how it fits into a cohesive framework for testing microservices.

December 27, 2023

by Stelios Manioudakis

CORE

· 21,401 Views · 5 Likes

The Latest Data Engineering Topics