Data Engineering Resources

How to Get There: Bridging the Technology Gap Preventing You From Adopting a Secrets-Free Machine Identity Framework

Learn how to go from a world of secrets sprawl and into a future with secrets-free machine identity frameworks by adopting SPIFFE/SPIRE

November 13, 2024

by Dwayne McDaniel

· 1,344 Views

Building NLU Flows With Firebase GenKit and GitHub Models Powered by LLMs

Learn how to set up an NLU flow using Firebase Genkit AI and Firebase Functions to detect intents and entities from text using GitHub Models.

November 13, 2024

by Xavier Portilla Edo

CORE

· 467 Views · 1 Like

Database Subsetting With Jailer

In this tutorial, you will learn how to export consistent sets of rows from relational databases to topologically sorted SQL-DML.

Updated November 13, 2024

by Ralf Wisser

· 15,440 Views · 3 Likes

Apache Iceberg: The Open Table Format for Lakehouses and Data Streaming

This article explores the table format wars of Apache Iceberg, Hudi, Delta Lake and XTable; and the product strategy of Snowflake, Databricks, Confluent, AWS, and Google.

November 12, 2024

by Kai Wähner

CORE

· 4,025 Views · 1 Like

LLMops: The Future of AI Model Management

LLMOps enhances MLOps for generative AI, focusing on prompt and RAG management to boost efficiency, scalability, and streamline deployment while tackling resource and complexity challenges.

November 12, 2024

by Suri Nuthalapati

CORE

· 7,153 Views · 1 Like

How to Run a MySQL Database in a Docker Container

Learn how to set up a containerized MySQL database with Docker, including steps for running, accessing, connecting from your host, and cleaning up the container.

November 12, 2024

by arvind toorpu

· 1,283 Views · 3 Likes

Preventing Accidental Deletions: Secure Cloud Management With Terraform

This is a quick guide to prevent accidental deletions in cloud infrastructure in Terraform, secure critical resources, and maintain a stable environment.

November 12, 2024

by Josephine Eskaline Joyce

CORE

· 725 Views · 3 Likes

Enhancing Code Analysis With Code Graphs

Explore how code graphs simplify code understanding and elevate software development, and discover tools that help improve your code analysis workflow.

November 12, 2024

by Balaji Dhamodharan

· 952 Views · 3 Likes

Understanding AI-Driven Adaptive Consistency in Distributed Systems

Learn how AI-powered adaptive consistency allows distributed systems to flexibly balance consistency, availability, and performance in real time.

November 12, 2024

by Suruchi Shah

· 768 Views · 1 Like

How Businesses Use Modern Development Platforms to Streamline Automation

In this article, we'll explore how modern development platforms are helping businesses streamline their automation efforts and achieve greater productivity.

November 12, 2024

by Stylianos Kampakis

· 761 Views · 1 Like

iRODS: An Open-Source Approach to Data Management in Large-Scale Research Environments

Discover iRODS, the open-source data management platform revolutionizing how enterprises handle large-scale datasets with policy-based automation and federation.

November 12, 2024

by Tom Smith

CORE

· 873 Views · 1 Like

Fetching Data From One-to-One, One-to-Many, and Many-to-Many Relationships With jOOQ

In this article, you will learn how to fetch data from tables with jOOQ, which have a one-to-one, a one-to-many, or a many-to-many relationship.

November 11, 2024

by Gunter Rotsaert

CORE

· 1,025 Views · 4 Likes

Open-Source AI Tools for More Efficient Development

Explore the best free and open-source AI tools to supercharge your development workflow from code generation and bug detection to machine learning integration.

November 11, 2024

by Santhosh Vijayabaskar

CORE

· 1,964 Views · 5 Likes

Microservices With .NET Core: Building Scalable and Resilient Applications

This article explores building scalable microservices with .NET Core, highlighting improved deployment, scalability, and resilience.

November 11, 2024

by Muhammad Rizwan

· 11,996 Views · 55 Likes

5 Tips for Fine-Tuning LLMs

Master LLM fine-tuning with expert tips on data quality, model architecture, and bias mitigation and boost performance and efficiency in AI development.

November 11, 2024

by Kevin Vu

· 1,296 Views · 1 Like

Revolutionize Speech-Based Chatbots With AI Agents

This article explores how large language models, generative AI, and retrieval-augmented generation enable the creation of highly reactive and intelligent AI agents.

November 11, 2024

by Prajwal Kulkarni

· 453 Views · 2 Likes

A Guide to Building Data Intelligence Systems: Strategic Practices to Building Robust, Ethical, and AI-Driven Data Structures

The foundation of data intelligence systems centers around transparency, governance, and the ethical and responsible exploitation of cutting-edge technologies, particularly GenAI.

November 8, 2024

by Frederic Jacquet

CORE

· 2,237 Views · 2 Likes

Secure Data Stack: Navigating Adoption Challenges of Data Encryption

Enhance data security with a gradual approach, focusing on areas like field-level and whole file encryption. Adopt data encryption and minimize day-to-day disruptions.

November 8, 2024

by Lulu Cheng

· 1,782 Views · 1 Like

Node.js Performance Tuning: Advanced Techniques to Follow

Discover techniques for Node.js performance tuning and optimize your apps with tips on memory management, asynchronous operations, and more.

November 7, 2024

by Sanjay Singhania

· 2,247 Views · 3 Likes

Build a Multilingual Chatbot With FastAPI and Google Cloud Translation

Create a multilingual chatbot that utilizes FastAPI and Google Cloud Translation for seamless communication across languages.

November 7, 2024

by Neha Dhaliwal

· 803 Views · 1 Like

The Latest Data Engineering Topics