Data Engineering Resources

Automating PMO Meetings With n8n Automation

The preps for PMO Meetings can take a lot of time. Here's how you can automate the process with n8n automation and cut the prep time into half.

October 10, 2024

by Asim Rais Siddiqui

· 3,311 Views · 1 Like

MariaDB Vector Edition: Designed for AI

In the era of purpose-built AI databases, how is a traditional database like MariaDB reinventing itself to stay relevant? Find out in this review.

October 10, 2024

by Vamsi Kavuri

CORE

· 18,774 Views · 9 Likes

Operationalize a Scalable AI With LLMOps Principles and Best Practices

This deep dive into MLOps and LLMOps looks at key components, practices, tools, and reference architecture with examples.

October 10, 2024

by Asia Banu Shaik

· 5,639 Views · 6 Likes

Leveraging Seekable OCI: AWS Fargate for Containerized Microservices

Learn how AWS Fargate can be leveraged to deploy microservices without managing the underlying infrastructure as well as techniques to optimize performance.

October 9, 2024

by Elakkiya Daivam

· 6,113 Views · 3 Likes

Observability for Browsers

Explore the architectural practices to navigate the unique challenges of ephemerality, low resources, and being efficient on the browser clients.

October 9, 2024

by Kranthi Kiran Erusu

· 4,188 Views · 1 Like

Microservice Proliferation: Too Many Microservices

Explore the pitfalls associated with the excessive creation of microservices, insights on their causes, implications, and potential strategies for mitigation.

October 9, 2024

by Sumit Kumar

· 8,508 Views · 1 Like

The Importance of Verifying Your GitHub Environment’s Security Controls

Source code, being the most valuable asset of an organization, demands strong, reliable protection to safeguard it from potential threats.

October 9, 2024

by Daria Kulikova

· 6,542 Views · 3 Likes

Decoding LLM Parameters, Part 2: Top-P (Nucleus Sampling)

The second article in this multi-part series explores how parameter tuning on Top-P impacts creativity, precision, and diversity in LLM content generation.

October 9, 2024

by Pavan Vemuri

· 4,478 Views · 4 Likes

Modify JSON Data in Postgres and Hibernate 6

In this series on supporting the Postgres JSON functions in a project using the Hibernate framework, learn about modification operations on JSON records.

October 9, 2024

by Szymon Tarnowski

CORE

· 11,800 Views · 6 Likes

DocAI: PDFs/Scanned Docs to Structured Data

In this article, discover a way to chat with AI and ask questions in the context of your scanned documents.

October 9, 2024

by Kriti B

· 3,024 Views · 1 Like

Introducing the New Dapr Jobs API and Scheduler Service

Learn about the Dapr 1.14 release last month introduced many new features, including the Jobs API and Scheduler control plane service for job management.

October 9, 2024

by Cassie Coyle

· 5,901 Views · 3 Likes

Optimizing IoT Performance in Industrial Environments

Read about the hardware and software optimizations to implement to maximize IoT performance in industrial environments.

October 9, 2024

by Zac Amos

· 5,143 Views · 2 Likes

Redefining Java Object Equality

Object equality is often a hot topic for assessing concepts and one of the pillars of how many of the implementations of Collection Frameworks work. Learn more.

October 8, 2024

by Soham Sengupta

· 6,137 Views · 4 Likes

Starting to Care About Security

IT practitioners get leaders to care about security by putting things in business (not technical) terms and using data to make their case.

October 8, 2024

by Leon Adato

· 4,192 Views · 1 Like

Enhancing Performance With Data Modeling: Techniques and Best Practices for Optimization in Snowflake

Explore advanced data modeling techniques, focusing on star schema, snowflake schema, and hybrid approaches.

October 8, 2024

by Harshavardhan Yedla

· 5,119 Views · 3 Likes

Cloud Cost Optimization: New Strategies for the AI Era

Explore new strategies for cloud cost optimization in the AI era, featuring insights from Stacklet CTO Kapil Thangavelu on FinOps, open source, and automation.

October 8, 2024

by Tom Smith

CORE

· 5,873 Views · 1 Like

Understanding the Differences Between Rate Limiting, Debouncing, and Throttling

Learn the differences between rate limiting, debouncing, and throttling, with examples and best practices for managing function execution.

October 8, 2024

by Charly Poly

· 3,630 Views · 3 Likes

PostgreSQL Everywhere and for Everything

PostgreSQL is versatile and can successfully handle less popular SQL scenarios and workflows that don’t use SQL at all. Let's see where Postgres shines.

October 8, 2024

by Adam Furmanek

CORE

· 8,193 Views · 10 Likes

Secret Management and Rotation

Learn about automating KMS key rotation for asymmetric keys to raise the security bar by replacing keys at an interval.

October 8, 2024

by Pranav Kumar Chaudhary

· 4,113 Views · 2 Likes

The Shift Left Architecture: From Batch and Lakehouse to Data Streaming

Explore the Shift Left Architecture using data streaming (Kafka/Flink) that enables data products for DWH, data lake, and lakehouses like Snowflake/Databricks.

October 8, 2024

by Kai Wähner

CORE

· 3,700 Views · 2 Likes

The Latest Data Engineering Topics