Data Engineering Resources

Applying Machine Learning for Predictive Capacity Planning in PostgreSQL Databases

Using LSTM machine learning models for PostgreSQL databases can effectively predict resource usage, helping to prevent bottlenecks and improve efficiency.

November 26, 2024

by ELANGO MUTHUSAMY

· 1,279 Views · 1 Like

A Practical Guide to Augmenting LLM Models With Function Calling

Learn how to build a more dynamic AI application using a no-code tool, enabling integration of external functions with OpenAI LLM.

November 26, 2024

by Javier Teso

· 1,799 Views · 2 Likes

Using Java Class Extension Library for Data-Oriented Programming

Discover an OOP approach to effectively separate data from domain-specific logic in data-oriented programming, utilizing the Java Class Extension Library.

November 26, 2024

by Gregory Ledenev

· 4,762 Views · 3 Likes

Elasticsearch Query and Indexing Architecture

This article breaks down Elasticsearch's core architecture by explaining how search queries and indexing requests flow through the system.

November 26, 2024

by Udbhav Prasad

· 4,283 Views · 6 Likes

Primer on Distributed Parallel Processing With Ray Using KubeRay

Learn what distributed parallel processing is and how to achieve it with Ray using KubeRay in Kubernetes to handle large-scale, resource-intensive tasks.

November 25, 2024

by Sudhanshu Prajapati

· 1,262 Views

Automate Developer Routine With Swift in iOS Development

As dev teams continue to implement more Agile methodologies and AI-driven processes, automation with Swift will be a strategy in staying competitive.

November 25, 2024

by Siarhei Misko

· 1,720 Views · 14 Likes

A Beginner’s Guide to GraphQL Interfaces and Unions

Learn about Interfaces and Unions in GraphQL, key concepts that simplify API development by allowing flexible data querying and improving query efficiency.

November 25, 2024

by Sugandha Singh

· 1,481 Views · 2 Likes

Building a Voice-Powered Smart Kitchen App Using LLaMA 3.1, Firebase, and Node.js

A step-by-step guide to creating a hands-free kitchen assistant with voice commands, real-time grocery list management, and recipe suggestions.

November 25, 2024

by Vaibhavi Tiwari

· 2,755 Views · 7 Likes

Mode Collapse in GANs: Can We Ever Completely Eliminate This Problem?

Mode collapse makes GANs produce repetitive outputs. Solutions exist, but none fully solve it. Curious how researchers are tackling this? Read on!

November 25, 2024

by Ashish Pawar

· 1,012 Views

Dust Actors and Large Language Models: An Application

Use Dust Java Actors to create a pipeline that automatically finds, reads, and extracts specific info from news articles based on your topic of interest.

November 25, 2024

by Alan Littleford

· 3,966 Views

The Benefits of Using Cloud for Big Data Processing

Let's discuss the multiple advantages of using cloud computing for big data processing, from scalability to cost-effectiveness and enhanced collaboration.

November 25, 2024

by Job Ready Program

· 2,669 Views · 2 Likes

Implementing a RAG Model for PDF Content Extraction and Query Answering

Using Python to extract and process text from a PDF document, generate embeddings, calculate cosine similarity, and answer queries using the extracted content.

November 22, 2024

by Vaibhavi Tiwari

· 7,823 Views · 8 Likes

Micro-Frontends in a Microservice Architecture

Learn about how a microservice architecture based on self-contained systems with clean architecture is a useful compromise of different alternatives.

November 22, 2024

by Sven Loesekann

· 3,583 Views · 4 Likes

Knowledge Graphs and RAG: A Guide to AI Knowledge Retrieval

Enter knowledge graphs, the secret weapon for superior RAG applications. This guide has everything you need to begin leveraging RAG for intelligent AI knowledge retrieval.

Updated November 21, 2024

by Pavan Vemuri

· 8,309 Views · 9 Likes

Maximizing AI Training Efficiency: Selecting the Right Model

Unlock AI training efficiency: Learn to select the right model architecture for your task. Explore CNNs, RNNs, Transformers, and more to maximize performance.

November 21, 2024

by Kevin Vu

· 1,039 Views · 1 Like

Everyone Uses Postgres...But Why?

All big players in the market use PostgreSQL nowadays. But why is that? Find out the answer in this article.

November 20, 2024

by Adam Furmanek

CORE

· 7,152 Views · 13 Likes

The Art of Separation in Data Science: Balancing Ego and Objectivity

Explore an example of learning the hard way that ego and ideas don’t mix, and how a “breakthrough” model flopped because of an overlooked data flaw.

November 20, 2024

by Sabarna Choudhuri

· 2,343 Views · 2 Likes

How to Enable Azure Databricks Lakehouse Monitoring Through Scripts

This guide uses Python scripts to enable Databricks Lakehouse Monitoring for snapshot profiles for all Delta Live Tables in a schema in the Azure environment.

November 20, 2024

by Soumya Barman

· 1,253 Views · 1 Like

Deploy Smarter, Not Harder: A Guide to Setting Up AWS CI/CD Pipelines for ECS

Learn how to automate and optimize your container deployments with AWS tools for faster, scalable, and reliable application delivery.

November 20, 2024

by Manish Parapudi

· 947 Views

The Transformer Algorithm: A Love Story of Data and Attention

The Transformer algorithm revolutionized AI by using attention mechanisms to process data contextually and simultaneously, enhancing accuracy in tasks.

November 20, 2024

by Vasanthi Govindaraj

· 2,323 Views · 6 Likes

The Latest Data Engineering Topics