Data Engineering Resources

Managing a Single-Writer RDBMS for a High-Scale Service

Single-writer RDBMS setup is not good for high-scale services. The data store should be horizontally scalable.

December 30, 2023

by Anirudha Bhadoriya

· 4,557 Views · 2 Likes

Create a Complete Computer Vision App in Minutes With Just Two Python Functions

Discover Pipeless, an open-source framework in computer vision development, and how you can create complete apps with just a few code functions.

December 29, 2023

by Miguel Angel Cabrera

· 5,143 Views · 3 Likes

SQL Looks Like English Is a Well-Intentioned Error

SQL is a language with very strict syntax, and any non-compliant part of a statement will be rejected by the database. Learn more about its advantages here.

December 29, 2023

by Judy Liu

· 3,748 Views · 2 Likes

Key Aspects of API Evolution: Version Control in Multi-Environments With API7 Enterprise

Let's learn the importance of version control and how API7 Enterprise plays an indispensable role in it with its robust gateway grouping functionality.

December 29, 2023

by Yilia Lin

· 4,509 Views · 3 Likes

How AI and Data Science in 2024 Will Shape Tomorrow's World

In 2024, AI and Data Science reshape healthcare, education, urban living, and business for efficiency and personalization.

December 29, 2023

by Manas Sadangi

· 6,018 Views · 2 Likes

Offline Data Pipeline Best Practices Part 2:Optimizing Airflow Job Parameters for Apache Hive

Discover how to optimize Apache Spark job configurations in Apache Airflow for cost-effective and efficient offline data pipelines.

December 29, 2023

by Mitesh Mangaonkar

· 5,798 Views · 3 Likes

Apache Doris Speeds Up Data Reporting, Tagging, and Data Lake Analytics

The user leverages the capabilities of Apache Doris in reporting, customer tagging, and data lake analytics and achieves high performance.

December 29, 2023

by Shirley H.

· 5,146 Views · 2 Likes

Cross-Pollination for Creativity Leveraging LLMs

Building a RAG application to leverage ideas from one field to another boosting creativity.

December 29, 2023

by Raghavan Muthuregunathan

· 4,685 Views · 1 Like

How To Use Artificial Intelligence to Optimize DevOps

AI pledges to transform DevOps by eliminating mistakes and errors while helping companies build self-learning and flexible systems.

December 28, 2023

by Chandra Shekhar

· 5,492 Views · 3 Likes

SQL Loader + Unix Script: Loading Multiple Data Files in Oracle DB Table

Explore the power of SQL Loader + Unix Script utility where multiple data files can be loaded by the SQL loader with automated shell scripts.

December 28, 2023

by ARINDAM GOSWAMI

· 6,996 Views · 8 Likes

Migrating From Lombok to Records in Java

Below article covers the process of migration from Lombok to Records.

December 28, 2023

by Fernando Boaglio

· 25,392 Views · 23 Likes

Unveiling the Power of Helidon 4: A Dive Into New Features

Helidon 4 introduces cutting-edge features for streamlined microservices development with newly released groundbreaking features.

December 28, 2023

by Andrei Tuchin

CORE

· 8,896 Views · 3 Likes

Quantum Coherence Unleashed: Illuminating AI Decision-Making Networks

Witness the synchronized quantum dance revolutionizing AI and discover the unseen threads of possibility in this groundbreaking exploration.

December 28, 2023

by Ayomide agarau

· 4,144 Views · 2 Likes

Transforming Telecom With AI/ML: A Deep Dive Into Smart Networks

AI and ML are transforming telecom, optimizing networks, enhancing customer experience, and detecting fraud.

December 28, 2023

by Ashok Gorantla

CORE

· 17,948 Views · 8 Likes

Optimizing Java Applications: Parallel Processing and Result Aggregation Techniques

This article highlights the focus on optimizing Java applications through the use of parallel processing and result aggregation techniques.

December 28, 2023

by Ahsan Shah

· 18,951 Views · 8 Likes

Beyond Murphy's Law

This article discusses a complementary or reciprocal aspect of Murphy's Law that I've often observed while working on large systems.

December 28, 2023

by Bertrand Florat

· 4,837 Views · 3 Likes

Top 10 Python Applications Transforming the Real World

In this article, we'll delve into Python's top ten real-world applications, exploring how it has transformed various domains.

December 28, 2023

by Madhuri Hammad

· 4,758 Views · 3 Likes

Unlocking Language Models With Powerful Prompts

Learn how to write effective prompts to unlock the full potential of large language models, enabling them to perform complex tasks.

December 28, 2023

by Amit Rai

· 4,142 Views · 5 Likes

Essential Skills for Modern Machine Learning Engineers: A Deep Dive

Machine learning experts often lack vital skills. This article explores ways to bridge these gaps and meet the evolving demands of the industry.

December 27, 2023

by Nikolai Babkin

· 58,213 Views · 96 Likes

How To Select the Right Vector Database for Your Enterprise GENERATIVE-AI Stack

We will explore the framework for choosing the correct Vector Database in an enterprise for building a GENERATIVE AI-based application.

December 27, 2023

by Suvoraj Biswas

· 6,923 Views · 3 Likes

The Latest Data Engineering Topics