Data Engineering Resources

Taming the Virtual Threads: Embracing Concurrency With Pitfall Avoidance

Learn what challenges you probably face when you try to run your microservices on the virtual threads. The challenge might be more complex and bigger if you need to import more Java libraries.

December 3, 2023

by Daniel Oh

CORE

· 9,218 Views · 4 Likes

Data Observability: Reliability in the AI Era

For GenAI, data observability must prioritize resolution, pipeline efficiency, and streaming and vector infrastructures.

December 2, 2023

by Lior Gavish

· 3,057 Views · 2 Likes

Keeping AI Infrastructure Costs Down With API Governance

API governance can help organizations control AI infrastructure costs by optimizing resource allocation, monitoring usage, enhancing security, and more.

December 2, 2023

by Rachael Kiselev

· 2,613 Views · 2 Likes

What to Do if You Expose a Secret: How to Stay Calm and Respond to an Incident

Learn how to respond to a secret leak incident effectively. Follow our guide to understand the impact, rotate secrets safely, and prep for future events.

December 2, 2023

by Dwayne McDaniel

· 2,825 Views · 2 Likes

Navigating Software Leadership in a Dynamic Era

Explore why leading in software isn't a static ride. Learn the risks of past success reliance, the dangers of detachment, and the importance of continual learning. Adapt, shatter illusions, and understand the evolution, including emerging roles like the Staff Engineer, bridging coding and strategy in the dynamic realm of software development.

December 2, 2023

by Otavio Santana

CORE

· 4,955 Views · 2 Likes

Understanding the New SEC Rules for Disclosing Cybersecurity Incidents

… and what this means for your incident detection and response.

December 2, 2023

by Alvin Lee

CORE

· 4,421 Views · 4 Likes

The Importance of Master Data Management (MDM)

Uncover evolving data integration strategies, from Data Mesh to API trends, reshaping how enterprises manage and leverage their data.

December 1, 2023

by Yvonne Parks

· 2,388 Views · 1 Like

Amazon Neptune Introduces a New Analytics Engine and the One Graph Vision

Amazon Neptune, the managed graph database service by AWS, makes analytics faster and more agile while introducing a vision aiming to simplify graph databases.

December 1, 2023

by George Anadiotis

· 2,785 Views · 1 Like

Why Device Farms Are Crucial for Streamlining Software Testing and Improving Efficiency

Device farms are a cloud-based solution that allows developers to test their software on a wide range of devices and browsers.

December 1, 2023

by Rohit Wadhwani

· 2,494 Views · 2 Likes

End-To-End Testing Unveiled: Navigating Challenges With a Personal Experience

In the dynamic world of software development, quality assurance stands as a formidable sentinel guarding the integrity and reliability of the digital realm we inhabit.

December 1, 2023

by Deepika Kale

· 2,331 Views · 2 Likes

Migrating Monolith Application to Microservices

Migrating a monolith application to microservices is time and resource-consuming and needs proper planning. This guide outlines the details of the migration process.

December 1, 2023

by Pranav Kumar Chaudhary

· 3,659 Views · 2 Likes

Handling Errors and Maintaining Data Integrity in ETL Processes

Learn key methods to identify, manage, and prevent errors in ETL processes, enhancing data integrity and business decision-making.

December 1, 2023

by Eduardo Moore

· 2,949 Views · 1 Like

Building Intelligent Chatbots With Streamlit, OpenAI, and Elasticsearch

Dive into the seamless integration of Streamlit, OpenAI, and Elasticsearch to craft sophisticated and intelligent chatbots for enhanced user experiences.

December 1, 2023

by Rama Krishna Panguluri

· 4,695 Views · 3 Likes

Quarkus 3: The Future of Java Microservices With Virtual Threads and Beyond

Learn how Quarkus integrates the virtual thread for Java developers to run blocking applications with a single @RunOnVirtualThread annotation.

December 1, 2023

by Daniel Oh

CORE

· 19,372 Views · 9 Likes

Embeddings and Vector Databases: A Hands-On Guide!

Generative AI is rapidly evolving, transforming the landscape of technology and data management in profound ways. Enter the world of vector databases.

December 1, 2023

by Pavan Belagatti

CORE

· 3,624 Views · 1 Like

The Power of Data-Driven Testing: A Deep Dive into Jakarta Persistence Specifications and NoSQL

Transforming legacy code with Jakarta Persistence: Data-driven testing, modern libraries, and tools enhance quality and efficiency.

December 1, 2023

by Otavio Santana

CORE

· 2,820 Views · 2 Likes

Unpacking Our Findings From Assessing Numerous Infrastructures: Part 1

AWS's Well-Architected framework can help you streamline your approach to ensure resilient, consistent, and scalable outcomes.

December 1, 2023

by Komal J Prabhakar

· 3,597 Views · 1 Like

Making Spring AI and OpenAI GPT Useful With RAG on Your Own Documents

Discover how to use RAG to improve your document search experience with Spring AI and OpenAI GPT. Learn how to make your own documents more useful.

December 1, 2023

by Sven Loesekann

· 8,707 Views · 6 Likes

Optimizing PgBench for CockroachDB Part 3

CockroachDB will support Read Committed isolation starting with the next release. I am going to test PgBench with RC in today's article.

December 1, 2023

by Artem Ervits

CORE

· 4,876 Views · 2 Likes

Harmonizing Space, Time, and Semantics: Navigating the Complexity of Geo-Distributed IoT Databases

Unleash the potential of spatial-temporal fusion in Geo-Distributed IoT databases for advanced query processing, harmonizing space, time, and semantics.

December 1, 2023

by Animesh Patel

· 3,190 Views · 1 Like

The Latest Data Engineering Topics