Data Engineering Resources

Modify JSON Data in Postgres and Hibernate 6

In this series on supporting the Postgres JSON functions in a project using the Hibernate framework, learn about modification operations on JSON records.

October 9, 2024

by Szymon Tarnowski

CORE

· 14,536 Views · 6 Likes

DocAI: PDFs/Scanned Docs to Structured Data

In this article, discover a way to chat with AI and ask questions in the context of your scanned documents.

October 9, 2024

by Kriti B

· 3,242 Views · 1 Like

Introducing the New Dapr Jobs API and Scheduler Service

Learn about the Dapr 1.14 release last month introduced many new features, including the Jobs API and Scheduler control plane service for job management.

October 9, 2024

by Cassie Coyle

· 6,361 Views · 3 Likes

Optimizing IoT Performance in Industrial Environments

Read about the hardware and software optimizations to implement to maximize IoT performance in industrial environments.

October 9, 2024

by Zac Amos

· 5,751 Views · 2 Likes

Redefining Java Object Equality

Object equality is often a hot topic for assessing concepts and one of the pillars of how many of the implementations of Collection Frameworks work. Learn more.

October 8, 2024

by Soham Sengupta

· 7,026 Views · 4 Likes

Starting to Care About Security

IT practitioners get leaders to care about security by putting things in business (not technical) terms and using data to make their case.

October 8, 2024

by Leon Adato

· 4,530 Views · 1 Like

Enhancing Performance With Data Modeling: Techniques and Best Practices for Optimization in Snowflake

Explore advanced data modeling techniques, focusing on star schema, snowflake schema, and hybrid approaches.

October 8, 2024

by Harshavardhan Yedla

· 7,021 Views · 3 Likes

Cloud Cost Optimization: New Strategies for the AI Era

Explore new strategies for cloud cost optimization in the AI era, featuring insights from Stacklet CTO Kapil Thangavelu on FinOps, open source, and automation.

October 8, 2024

by Tom Smith

CORE

· 6,859 Views · 2 Likes

Understanding the Differences Between Rate Limiting, Debouncing, and Throttling

Learn the differences between rate limiting, debouncing, and throttling, with examples and best practices for managing function execution.

October 8, 2024

by Charly Poly

· 4,063 Views · 3 Likes

PostgreSQL Everywhere and for Everything

PostgreSQL is versatile and can successfully handle less popular SQL scenarios and workflows that don’t use SQL at all. Let's see where Postgres shines.

October 8, 2024

by Adam Furmanek

CORE

· 9,556 Views · 11 Likes

Secret Management and Rotation

Learn about automating KMS key rotation for asymmetric keys to raise the security bar by replacing keys at an interval.

October 8, 2024

by Pranav Kumar Chaudhary

· 4,920 Views · 2 Likes

The Shift Left Architecture: From Batch and Lakehouse to Data Streaming

Explore the Shift Left Architecture using data streaming (Kafka/Flink) that enables data products for DWH, data lake, and lakehouses like Snowflake/Databricks.

October 8, 2024

by Kai Wähner

CORE

· 4,123 Views · 2 Likes

Mastering AI Agents: How Agentic Design Patterns Make Agents Smarter

Discover how Agentic Design Patterns can transform your AI workflows by breaking down complex tasks into manageable, specialized AI agents.

October 7, 2024

by Noorain Panjwani

· 7,599 Views · 4 Likes

Integrate Spring Boot With jOOQ, Liquibase, and Testcontainers

Get started with jOOQ, Liquibase, and Testcontainers: Create a basic Spring Boot application and integrate the aforementioned techniques including a test setup.

October 7, 2024

by Gunter Rotsaert

CORE

· 6,044 Views · 1 Like

Natural Language SQL Query Application

Walk through building a powerful and intuitive web application that converts natural language into SQL queries and retrieves data from a PostgreSQL database.

October 7, 2024

by Balusamy Nachiappan

· 5,242 Views · 2 Likes

In-House Model Serving Infrastructure for GPU Flexibility

In this article, learn how to create a GPU SKU-agnostic serving infrastructure for flexibility, efficiency, and resilience.

October 7, 2024

by Suruchi Shah

· 5,341 Views · 1 Like

Low Code AI Agent Using Kumologica and Anthropic AI for Customer Feedback Sentiment Analysis

The article covers the design and implementation of a low code AI agent developed using Kumologica and Anthropic AI for customer feedback sentiment analysis.

October 7, 2024

by Pranav K

CORE

· 2,866 Views · 2 Likes

The Disruptive Potential of On-Device Large Language Models

Explore the advancements of on-device AI and how it will revolutionize our daily interactions with technology, making our lives more efficient and connected.

October 7, 2024

by Rishab Mehra

· 7,605 Views · 9 Likes

Curating Efficient Distributed Application Runtime (Dapr) Workflows

With Dapr and its powerful abstractions, writing resilient workflows is easy. In this article, we will understand how to write one with an example.

October 4, 2024

by Siri Varma Vegiraju

CORE

· 10,283 Views · 4 Likes

How to Build a RAG-Powered Chatbot With Google Gemini and MyScaleDB

Learn to construct a RAG-powered chatbot using Google Gemini models and MyScaleDB, including installing dependencies, preparing data, generating embeddings,etc.

October 4, 2024

by Usama Jamil

· 3,714 Views · 2 Likes

The Latest Data Engineering Topics