Data Engineering Resources

Automate Private Azure Databricks Unity Catalog Creation

This article provides detailed steps to automate a private Databricks Unity Catalog creation in Azure subscription.

October 21, 2024

by Soumya Barman

· 3,289 Views · 1 Like

PostgreSQL 17: A Major Step Forward in Performance, Logical Replication, and More

Explore PostgreSQL 17 features such as improved query performance with materialized CTEs, propagating pathkeys from a CTE to an outer query, and more.

October 21, 2024

by Ahsan Hadi

· 4,338 Views · 2 Likes

Tech Trends 2024: Highlights on the Current Tech Industry From a Developer

The tech landscape is changing fast. Get the pulse on the latest topics and trends in technology from one developer's perspective.

October 21, 2024

by Jennifer Reif

CORE

· 3,478 Views · 1 Like

Hybrid Search: A New Frontier in Enterprise Search

Discover how hybrid search, with its exceptional search capabilities, can deliver relevant results with utmost accuracy for a better search experience.

October 21, 2024

by Taranjeet Singh

· 1,539 Views · 2 Likes

Dust: Open-Source Actors for Java

Dust integrates a robust Actor system with Java virtual threads. This paradigm removes common problems associated with massively multi-threaded applications.

October 21, 2024

by Alan Littleford

· 8,144 Views · 5 Likes

How to Secure Your Raspberry Pi and Enable Safe, Resilient Updates

Learn how to safely encrypt and sign your Raspberry Pi filesystem and make reliably, recoverable updates easy and safe using hardware-based encryption.

October 21, 2024

by David G. Simmons

CORE

· 7,226 Views · 2 Likes

How to Use Self Join and WITH Clause in Oracle

The Oracle WITH clause is one of the most commonly used techniques to simplify the SQL source code and improve performance.

October 18, 2024

by Sachin More

· 4,356 Views · 6 Likes

Secure Golden Images: A Blueprint for Vulnerability Management

In this article, learn about securing your AWS EC2 instances by deploying Secure Golden Images (SGIs) at regular intervals.

October 18, 2024

by Jake Howering

· 4,895 Views · 2 Likes

Entity Creation With Asynchronous Pipelines in Distributed Systems

This article explores the benefits and challenges of async pipelines and provides practical solutions for creating resilient and scalable systems.

October 18, 2024

by Sugandha Singh

· 3,210 Views · 2 Likes

Should You Use AI Code Review Tools?

AI code review tools like GitHub Copilot, CodeRabbit, and Codium AI are becoming popular — but they aren't better than human reviewers in every respect.

October 17, 2024

by Zac Amos

· 3,730 Views · 3 Likes

Web GenAI Microservices Creation: An Overview

Create and run a microservice, with a simple prompt from your browser. Download and customize the system in your IDE with rules and Python, all open source!

October 17, 2024

by Val Huber

CORE

· 5,742 Views · 6 Likes

Automate Azure Databricks Unity Catalog Permissions at the Catalog Level

Detailed script for automating permission management for Databricks Unity Catalog at catalog level.

October 16, 2024

by Soumya Barman

· 4,417 Views · 1 Like

Artificial Intelligence and Machine Learning in Cloud-Native Environments

The integration of AI/ML technologies in cloud-native environments offers some exciting features, but is not without its challenges.

October 16, 2024

by Reese Lee

· 5,545 Views · 5 Likes

How to Convert HTML to DOCX in Java

Converting HTML to DOCX makes web-based content accessible to a wide audience of non-technical content collaborators; automating this conversion is easy with APIs.

October 16, 2024

by Brian O'Neill

CORE

· 10,047 Views · 7 Likes

DevoxxGenie: Your AI Assistant for IntelliJ IDEA

This tutorial will provide you the steps and recommendations to best leverage the DevoxxGenie plugin for either local or cloud-based LLM code assistant tools.

October 16, 2024

by Gunter Rotsaert

CORE

· 3,501 Views · 4 Likes

Building an Interactive Chatbot With Streamlit, LangChain, and Bedrock

The article helps you to create a chatbot using low code frontend, LangChain for conversation management, and Bedrock LLM for generating responses.

October 16, 2024

by Karan Bansal

· 3,325 Views · 6 Likes

Event-Driven vs Event-Sourced: A Common Misunderstanding

The terms “event-driven” and “event-sourced” are often used interchangeably, while in reality, the two are very different concepts.

October 16, 2024

by Ernest Sak

· 5,552 Views · 9 Likes

How to Simplify Complex Conditions With Python's Match Statement

Learn the benefits of pattern matching, how it can simplify your code, and examples of improvement techniques and pattern guards.

October 15, 2024

by Sameer Shukla

CORE

· 3,105 Views · 2 Likes

AI Strategies for Enhanced Language Model Performance

This article explores the concept of compositionality, the challenges associated with it, and advanced strategies to improve language models' ability to reason compositionally.

October 15, 2024

by Nakul Pandey

· 2,723 Views · 2 Likes

Domain-Driven Design: Manage Data With Jakarta Data and JNoSQL

Learn how to simplify data management in DDD applications through practical examples of using domain-focused repositories and business semantics across databases.

October 15, 2024

by Otavio Santana

CORE

· 4,348 Views · 4 Likes

The Latest Data Engineering Topics