Data Engineering Resources

End-To-End Testing Unveiled: Navigating Challenges With a Personal Experience

In the dynamic world of software development, quality assurance stands as a formidable sentinel guarding the integrity and reliability of the digital realm we inhabit.

December 1, 2023

by Deepika Kale

· 2,304 Views · 2 Likes

Migrating Monolith Application to Microservices

Migrating a monolith application to microservices is time and resource-consuming and needs proper planning. This guide outlines the details of the migration process.

December 1, 2023

by Pranav Kumar Chaudhary

· 3,651 Views · 2 Likes

Handling Errors and Maintaining Data Integrity in ETL Processes

Learn key methods to identify, manage, and prevent errors in ETL processes, enhancing data integrity and business decision-making.

December 1, 2023

by Eduardo Moore

· 2,937 Views · 1 Like

Building Intelligent Chatbots With Streamlit, OpenAI, and Elasticsearch

Dive into the seamless integration of Streamlit, OpenAI, and Elasticsearch to craft sophisticated and intelligent chatbots for enhanced user experiences.

December 1, 2023

by Rama Krishna Panguluri

· 4,669 Views · 3 Likes

Quarkus 3: The Future of Java Microservices With Virtual Threads and Beyond

Learn how Quarkus integrates the virtual thread for Java developers to run blocking applications with a single @RunOnVirtualThread annotation.

December 1, 2023

by Daniel Oh

CORE

· 19,329 Views · 9 Likes

Embeddings and Vector Databases: A Hands-On Guide!

Generative AI is rapidly evolving, transforming the landscape of technology and data management in profound ways. Enter the world of vector databases.

December 1, 2023

by Pavan Belagatti

CORE

· 3,586 Views · 1 Like

The Power of Data-Driven Testing: A Deep Dive into Jakarta Persistence Specifications and NoSQL

Transforming legacy code with Jakarta Persistence: Data-driven testing, modern libraries, and tools enhance quality and efficiency.

December 1, 2023

by Otavio Santana

CORE

· 2,806 Views · 2 Likes

Unpacking Our Findings From Assessing Numerous Infrastructures: Part 1

AWS's Well-Architected framework can help you streamline your approach to ensure resilient, consistent, and scalable outcomes.

December 1, 2023

by Komal J Prabhakar

· 3,589 Views · 1 Like

Making Spring AI and OpenAI GPT Useful With RAG on Your Own Documents

Discover how to use RAG to improve your document search experience with Spring AI and OpenAI GPT. Learn how to make your own documents more useful.

December 1, 2023

by Sven Loesekann

· 8,637 Views · 6 Likes

Optimizing PgBench for CockroachDB Part 3

CockroachDB will support Read Committed isolation starting with the next release. I am going to test PgBench with RC in today's article.

December 1, 2023

by Artem Ervits

CORE

· 4,809 Views · 2 Likes

Harmonizing Space, Time, and Semantics: Navigating the Complexity of Geo-Distributed IoT Databases

Unleash the potential of spatial-temporal fusion in Geo-Distributed IoT databases for advanced query processing, harmonizing space, time, and semantics.

December 1, 2023

by Animesh Patel

· 3,179 Views · 1 Like

Methods of Source Code Management and Data Protection

This article explores the crucial components of secure development practices, emphasizing the synergy of advanced tools within the DevOps framework.

November 30, 2023

by Roman Burdiuzha

· 3,255 Views · 2 Likes

Leonardo AI: Midjourney’s New Competitor

Leonardo AI is progressively emerging as a prominent alternative, challenging the position previously established by Midjourney.

November 30, 2023

by Isaac Alvarez

· 1,987 Views · 1 Like

Simplifying SPIFFE: Accessible Workload Identity

SPIRL focuses on making SPIFFE (Secure Production Identity Framework for Everyone) more accessible and manageable for a broader audience.

November 30, 2023

by Quintessence Anx

· 2,531 Views · 1 Like

Decoding Exponential Backoff: A Blueprint for Robust Communication

Exponential Backoff is a network algorithm that prevents overload during outages and can be useful for distributed systems.

November 30, 2023

by Roopa Kushtagi

· 1,742 Views · 2 Likes

The Guide to SRE Principles

This article covers key principles that underlie SRE, provides some examples of those key principles, and includes relevant details and illustrations to clarify these examples.

November 30, 2023

by Vishal Padghan

· 3,976 Views · 3 Likes

Exploring Apache Airflow for Batch Processing Scenario

In this article, let's explore a simple use case of processing an input file and writing back to the output file using Apache Airflow.

November 30, 2023

by kalpesh barde

· 6,724 Views · 5 Likes

Accelerating Insights With Couchbase Columnar

Insights come from observing and analyzing data from all sources. Couchbase Columnar helps quickly analyze data from a variety of data sources with zero-ETL.

November 30, 2023

by Keshav Murthy

CORE

· 2,437 Views · 2 Likes