Data Engineering Resources

As a gentle introduction to stream processing, we’ve defined what it is, how it differs from batch processing, and how computation works in stream processing.

May 1, 2024

by Federico Trotta

· 4,128 Views · 5 Likes

API-Based Web Service as Serverless Function

Serverless architecture is a method of decoupling server maintenance, scalability, and availability from the development process.

May 1, 2024

by Madhan Muralimanohar

· 1,894 Views · 1 Like

Files and Exceptions in Python

Exceptions are special objects that Python uses to manage errors that occur when a program is running. Here, learn to work with files and handle exceptions.

April 30, 2024

by Duncan Ndegwa

· 1,742 Views · 2 Likes

The Evolution of Platform Extensibility

From API to AI, this article attempts to capture the state of extensibility and charts a course for what the future might hold.

April 30, 2024

by Ashwin Ganesh Krishnamurthy

· 1,561 Views · 1 Like

Exploration of Azure OpenAI

Follow an overview of Azure Open AI and its significance in the field of artificial intelligence, learning how to build intelligent applications.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 2,544 Views · 3 Likes

Expose Your Database as a REST API Safely and Without Code

DB2Rest is open-source middleware that offers a no-code way to safely expose data from your database for your applications to consume.

April 30, 2024

by Thad Guidry

· 2,903 Views · 2 Likes

Designing Communication Architectures With Microservices

Communication between microservices should be robust and efficient.

April 30, 2024

by Swathi Prasad

· 4,636 Views · 5 Likes

AI-Driven Development: Maximizing Efficiency With GitHub Copilot and Seamless Chat Collaboration in Visual Studio IDE

GitHub Copilot AI assistant speeds up development by providing automatic code completions, suggestions, and many more that enhance developer's productivity.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 2,522 Views · 3 Likes

AI Is BS Spelled AI

What is AI? In this opinion piece, follow along with the discussion of whether artificial intelligence or virtual assistance is the end goal.

April 29, 2024

by Greg Hall

· 1,145 Views · 1 Like

Implementing RSA From Scratch in Python (Part 2)

In Part 2 of this Python series, explore a discussion about Random Prime Numbers and the Fibonacci Number Calculation when implementing RSA from scratch.

April 29, 2024

by Traven West

· 1,330 Views · 1 Like

Develop XR With Oracle, Ep 7: Teleport Live 3D Objects From Ray-Bans to Magic Leap, Quest, Vision Pro, and 3D Printers

Share live 3D objects captured with Ray-Bans with XR (AR, VR, or MR) and/or 3D printers with a similar experience as what exists today for 2D pictures/printers.

April 29, 2024

by Paul Parkinson

· 3,946 Views · 2 Likes

When APIs Go Wrong: Neglecting Rate Limiting

Authentication is important, though not a complete defense. Rate-limiting policies add an extra line of protection to reduce the impact on compromised APIs.

April 29, 2024

by Hugo Guerrero

CORE

· 2,183 Views · 1 Like

Uber's Success With Apache Pinot: Cost Savings and Performance Boost

Uber migrated from Elasticsearch to Apache Pinot and saw a 70% reduction in costs, an 80% reduction in CPU cores, and a decrease in page load times and query timeouts.

April 29, 2024

by Kristin Crosier

· 1,895 Views · 3 Likes

How To Create Auto Scaling in AWS

This blog post will help you create Auto Scaling in AWS, a collection of Amazon Ec2 instances with similar characteristics among them in just a group.

April 29, 2024

by Alfonso Valdes

· 2,059 Views · 1 Like

Gain Lightning Fast Reads and Writes Without Changing Your PostgreSQL Application

Walk through how the YugabyteDB distributed database lowers read and write latency and (most importantly) runs an existing PostgreSQL application with no costly rewrite.

April 29, 2024

by Jim Knicely

· 1,207 Views · 1 Like

Multiplatform Directory Bookmarks on the Command Line

This article discusses how to manage directory bookmarks on the command line for efficient use of the character terminal.

April 29, 2024

by Pavel Ponec

· 2,102 Views · 1 Like

Adjusting Data Before Sending It to Kentik NMS

Sometimes, you want to modify data before displaying it in your network monitoring system. So strap in and let’s get mathy!

April 29, 2024

by Leon Adato

· 1,523 Views · 1 Like

Why Cloud Native Is Vital to Your Organization's APIs: The Impact Could Be More Than Expected

As your API infrastructure expands, a cloud-native design provides the necessary tooling to ease supportability and manageability efforts.

April 29, 2024

by John Vester

CORE

· 59,130 Views · 2 Likes

The Simplest Ingredient for Developing Real-Time Front-End Applications

How to build a real-time frontend application using Redpanda Serverless, Pusher, and Vercel. Managing streaming data, and setting up real-time communication channels.

April 29, 2024

by Christina Lin

CORE

· 4,790 Views · 4 Likes

How To Use Retrieval Augmented Generation (RAG) for Go Applications

In this article, learn how to implement RAG (using LangChain and PostgreSQL) to improve the accuracy and relevance of LLM outputs.

April 29, 2024

by Abhishek Gupta

CORE

· 3,448 Views · 2 Likes

The Latest Data Engineering Topics