Data Engineering Resources

Understanding the New SEC Rules for Disclosing Cybersecurity Incidents

… and what this means for your incident detection and response.

December 2, 2023

by Alvin Lee

CORE

· 5,731 Views · 4 Likes

The Importance of Master Data Management (MDM)

Uncover evolving data integration strategies, from Data Mesh to API trends, reshaping how enterprises manage and leverage their data.

December 1, 2023

by Yvonne Parks

· 2,779 Views · 1 Like

Amazon Neptune Introduces a New Analytics Engine and the One Graph Vision

Amazon Neptune, the managed graph database service by AWS, makes analytics faster and more agile while introducing a vision aiming to simplify graph databases.

December 1, 2023

by George Anadiotis

· 3,295 Views · 1 Like

Why Device Farms Are Crucial for Streamlining Software Testing and Improving Efficiency

Device farms are a cloud-based solution that allows developers to test their software on a wide range of devices and browsers.

December 1, 2023

by Rohit Wadhwani

· 2,903 Views · 2 Likes

End-To-End Testing Unveiled: Navigating Challenges With a Personal Experience

In the dynamic world of software development, quality assurance stands as a formidable sentinel guarding the integrity and reliability of the digital realm we inhabit.

December 1, 2023

by Deepika Kale

· 3,378 Views · 2 Likes

Migrating Monolith Application to Microservices

Migrating a monolith application to microservices is time and resource-consuming and needs proper planning. This guide outlines the details of the migration process.

December 1, 2023

by Pranav Kumar Chaudhary

· 4,237 Views · 2 Likes

Handling Errors and Maintaining Data Integrity in ETL Processes

Learn key methods to identify, manage, and prevent errors in ETL processes, enhancing data integrity and business decision-making.

December 1, 2023

by Eduardo Moore

· 3,501 Views · 1 Like

Building Intelligent Chatbots With Streamlit, OpenAI, and Elasticsearch

Dive into the seamless integration of Streamlit, OpenAI, and Elasticsearch to craft sophisticated and intelligent chatbots for enhanced user experiences.

December 1, 2023

by Rama Krishna Panguluri

· 5,554 Views · 3 Likes

Quarkus 3: The Future of Java Microservices With Virtual Threads and Beyond

Learn how Quarkus integrates the virtual thread for Java developers to run blocking applications with a single @RunOnVirtualThread annotation.

December 1, 2023

by Daniel Oh

CORE

· 21,072 Views · 9 Likes

Embeddings and Vector Databases: A Hands-On Guide!

Generative AI is rapidly evolving, transforming the landscape of technology and data management in profound ways. Enter the world of vector databases.

December 1, 2023

by Pavan Belagatti

CORE

· 4,804 Views · 1 Like

The Power of Data-Driven Testing: A Deep Dive into Jakarta Persistence Specifications and NoSQL

Transforming legacy code with Jakarta Persistence: Data-driven testing, modern libraries, and tools enhance quality and efficiency.

December 1, 2023

by Otavio Santana

CORE

· 3,539 Views · 2 Likes

Unpacking Our Findings From Assessing Numerous Infrastructures: Part 1

AWS's Well-Architected framework can help you streamline your approach to ensure resilient, consistent, and scalable outcomes.

December 1, 2023

by Komal J Prabhakar

· 4,109 Views · 1 Like

Making Spring AI and OpenAI GPT Useful With RAG on Your Own Documents

Discover how to use RAG to improve your document search experience with Spring AI and OpenAI GPT. Learn how to make your own documents more useful.

December 1, 2023

by Sven Loesekann

· 10,627 Views · 7 Likes

Optimizing PgBench for CockroachDB Part 3

CockroachDB will support Read Committed isolation starting with the next release. I am going to test PgBench with RC in today's article.

December 1, 2023

by Artem Ervits

CORE

· 5,605 Views · 2 Likes

Harmonizing Space, Time, and Semantics: Navigating the Complexity of Geo-Distributed IoT Databases

Unleash the potential of spatial-temporal fusion in Geo-Distributed IoT databases for advanced query processing, harmonizing space, time, and semantics.

December 1, 2023

by Animesh Patel

· 3,953 Views · 1 Like

Methods of Source Code Management and Data Protection

This article explores the crucial components of secure development practices, emphasizing the synergy of advanced tools within the DevOps framework.

November 30, 2023

by Roman Burdiuzha

· 4,004 Views · 2 Likes

Leonardo AI: Midjourney’s New Competitor

Leonardo AI is progressively emerging as a prominent alternative, challenging the position previously established by Midjourney.

November 30, 2023

by Isaac Alvarez

· 2,357 Views · 1 Like

Simplifying SPIFFE: Accessible Workload Identity

SPIRL focuses on making SPIFFE (Secure Production Identity Framework for Everyone) more accessible and manageable for a broader audience.

November 30, 2023

by Quintessence Anx

· 3,138 Views · 1 Like

Decoding Exponential Backoff: A Blueprint for Robust Communication

Exponential Backoff is a network algorithm that prevents overload during outages and can be useful for distributed systems.

November 30, 2023

by Roopa Kushtagi

· 2,592 Views · 2 Likes

The Guide to SRE Principles

This article covers key principles that underlie SRE, provides some examples of those key principles, and includes relevant details and illustrations to clarify these examples.

November 30, 2023

by Vishal Padghan

· 4,989 Views · 3 Likes

The Latest Data Engineering Topics