Data Engineering Resources

Improving the Capabilities of LLM-Based Analytics Copilots With Semantic Search and Fine-Tuning

Learn how LLMs can be deployed to make critical decisions like domain-specific question-answering, SQL generation needed for data retrieval, and more.

July 22, 2024

by sai arava

· 2,350 Views · 1 Like

Building Database Connections and Migrations in Go With GORM and Goose

This article walks you through setting up a robust database client, handling migrations, preloading associations, and querying data efficiently.

July 20, 2024

by Bhanuprakash Jirra

· 5,375 Views · 2 Likes

Topic Tagging Using Large Language Models

Explore various techniques for organizing large amounts of content into topics using Large Language Models.

July 19, 2024

by Vikram Rao Sudarshan

· 3,496 Views · 1 Like

A Guide to Security Controls for Risk-Based API Protection

In this post, we are going to navigate risk-based API security controls which are essential in helping you construct more solid and tamper-proof APIs.

July 19, 2024

by Kalyan Gottipati

· 4,647 Views · 2 Likes

Microservice Logs Testing in the Cloud: Important but Often Ignored

Microservice logs are vital but often overlooked. Learn why structured logging and thorough testing are essential for reliable cloud apps.

July 19, 2024

by Abhinav Garg

· 4,100 Views · 3 Likes

AWS CDK: Infrastructure as Abstract Data Types, Part 3

At the end of the first part of this CDK series, we promised to demonstrate how to programmatically manage the S3 bucket created as a part of our stack. Let's see it now.

July 18, 2024

by Nicolas Duminil

CORE

· 7,458 Views · 2 Likes

Oracle Advanced Queue: A Guide

In this article, we'll look at what oracle advanced queue (AQ) is, explore some of the use cases, and consider common best practices while implementing queue.

July 18, 2024

by Hemant Kulkarni

· 4,962 Views · 5 Likes

The Future of AI Art: Exploring the Capabilities of Stable Diffusion Web UI (Automatic 1111)

Automatic 1111's web UI for Stable Diffusion simplifies AI Image Generation: text-to-image, sketch-to-image, model training, and API integration detailed.

July 18, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 3,975 Views · 6 Likes

Boomi's API Control Plane: Simplifying API Management for Developers

Boomi's new API Control Plane simplifies API management with centralized discovery, federated control, and enhanced security, revolutionizing how developers handle APIs.

July 18, 2024

by Tom Smith

CORE

· 3,801 Views · 1 Like

AWS CDK: Infrastructure as Abstract Data Types, Part 2

In part 2 of this journey into the CDK world, explore how to use basic building blocks like constructs by taking advantage of Quarkus features.

July 17, 2024

by Nicolas Duminil

CORE

· 6,914 Views · 4 Likes

A Comprehensive Guide to MLflow for Machine Learning Lifecycle Management

Master MLflow from basics to advanced with practical examples and an end-to-end project for managing ML lifecycles using this comprehensive guide.

July 17, 2024

by Harsh Daiya

CORE

· 3,732 Views · 1 Like

Mastering Full-Stack Development: A Comprehensive Beginner’s Guide to the MERN Stack

From setting up your environment to building dynamic web applications: a step-by-step journey through MongoDB, Express.js, React, and Node.js.

July 17, 2024

by Nitesh Upadhyaya

CORE

· 5,275 Views · 5 Likes

Dynamic Watermarking With IMGProxy and Apache APISIX

In this post, we implement a watermarking feature with the help of imgproxy. The more I think about it, the more I think they make a match made in Heaven.

July 17, 2024

by Nicolas Fränkel

CORE

· 5,122 Views · 1 Like

AI Agentic 101: Understanding Artificial Intelligence Agents

What is agentic AI and how do these autonomous systems improve productivity, facilitate smarter decisions, and at the end of the day revolutionize industries?

July 17, 2024

by Frederic Jacquet

CORE

· 4,848 Views · 4 Likes

How To Convert Common Documents to PNG Image Arrays in Java

Learn how to convert Office documents, PDFs, and 100+ images to an array of PNG images, and review some of the benefits of making PNG conversions over other formats.

July 17, 2024

by Brian O'Neill

CORE

· 5,280 Views · 3 Likes

An Introduction to GraphQL: Simplifying Data Fetching With Real-World Examples

Understanding the basics of GraphQL: How to define schemas, set up a server, and integrate with front-end applications for efficient data management.

July 17, 2024

by Nitesh Upadhyaya

CORE

· 4,289 Views · 4 Likes

Why the Newest LLMs Use a MoE (Mixture of Experts) Architecture

Learn about the Mixture of Experts (MoE) architecture, defined as a mix or blend of different "expert" models working together to complete a specific problem.

July 17, 2024

by Kevin Vu

· 5,487 Views · 3 Likes

When Not to Choose Google Apache Kafka for BigQuery

When not to choose Google Apache Kafka for BigQuery — a review, comparison with Confluent Cloud, and data streaming landscape outlook.

July 16, 2024

by Kai Wähner

CORE

· 4,367 Views · 1 Like

Oracle SQL: Understanding Execution Plan and Performance Tuning

In this article, we will explore how each database generates and utilizes "explain" plans, highlighting the strengths and potential pitfalls of their approaches.

July 16, 2024

by Raosaheb Ghule

· 4,980 Views · 7 Likes

Understanding Big O Notation in Python

Learning Big O notation is crucial because it helps us understand the current efficiency of our code and guides us in optimizing it further.

July 16, 2024

by Shital Kat

· 3,174 Views · 1 Like

The Latest Data Engineering Topics