Data Engineering Resources

Navigating Cloud-Native Components: Using Service Registry and Definitions

Explore the service registry and service definitions, which are crucial components in cloud-native architecture for efficient, reliable, and scalable applications.

May 2, 2024

by Gaurav Gaur

CORE

· 1,613 Views · 3 Likes

Exploring FAPI 2.0: The Latest in API Security Technology

This post explores FAPI standards, which enhance secure data exchange in high-risk sectors, evolving from OAuth 2.0-based FAPI 1.0 to the more secure FAPI 2.0.

May 1, 2024

by Hideki Ikeda

· 1,887 Views · 2 Likes

Data Warehouse for Data Science: Adopting Arrow Flight SQL for 10X Data Transfer

Apache Doris 2.1 supports Arrow Flight SQL protocol for reading data from Doris. It delivers tenfold speedups compared to PyMySQL and Pandas.

May 1, 2024

by Shirley H.

· 1,219 Views · 2 Likes

Reliability Models and Metrics for Test Engineering

Explore how reliability models and metrics help identify potential weak spots, anticipate failures, and build better products.

May 1, 2024

by Stelios Manioudakis, PhD

CORE

· 5,340 Views · 2 Likes

An Introduction to Stream Processing

As a gentle introduction to stream processing, we’ve defined what it is, how it differs from batch processing, and how computation works in stream processing.

May 1, 2024

by Federico Trotta

· 2,432 Views · 4 Likes

API-Based Web Service as Serverless Function

Serverless architecture is a method of decoupling server maintenance, scalability, and availability from the development process.

May 1, 2024

by Madhan Muralimanohar

· 1,345 Views · 1 Like

Files and Exceptions in Python

Exceptions are special objects that Python uses to manage errors that occur when a program is running. Here, learn to work with files and handle exceptions.

April 30, 2024

by Duncan Ndegwa

· 1,097 Views · 2 Likes

The Evolution of Platform Extensibility

From API to AI, this article attempts to capture the state of extensibility and charts a course for what the future might hold.

April 30, 2024

by Ashwin Ganesh Krishnamurthy

· 1,099 Views · 1 Like

Exploration of Azure OpenAI

Follow an overview of Azure Open AI and its significance in the field of artificial intelligence, learning how to build intelligent applications.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 1,292 Views · 3 Likes

Expose Your Database as a REST API Safely and Without Code

DB2Rest is open-source middleware that offers a no-code way to safely expose data from your database for your applications to consume.

April 30, 2024

by Thad Guidry

· 1,578 Views · 2 Likes

Designing Communication Architectures With Microservices

Communication between microservices should be robust and efficient.

April 30, 2024

by Swathi Prasad

· 3,266 Views · 4 Likes

AI-Driven Development: Maximizing Efficiency With GitHub Copilot and Seamless Chat Collaboration in Visual Studio IDE

GitHub Copilot AI assistant speeds up development by providing automatic code completions, suggestions, and many more that enhance developer's productivity.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 1,544 Views · 3 Likes

AI Is BS Spelled AI

What is AI? In this opinion piece, follow along with the discussion of whether artificial intelligence or virtual assistance is the end goal.

April 29, 2024

by Greg Hall

· 728 Views · 1 Like

Implementing RSA From Scratch in Python (Part 2)

In Part 2 of this Python series, explore a discussion about Random Prime Numbers and the Fibonacci Number Calculation when implementing RSA from scratch.

April 29, 2024

by Traven West

· 810 Views · 1 Like

Develop XR With Oracle, Ep 7: Teleport Live 3D Objects From Ray-Bans to Magic Leap, Quest, Vision Pro, and 3D Printers

Share live 3D objects captured with Ray-Bans with XR (AR, VR, or MR) and/or 3D printers with a similar experience as what exists today for 2D pictures/printers.

April 29, 2024

by Paul Parkinson

· 3,096 Views · 2 Likes

When APIs Go Wrong: Neglecting Rate Limiting

Authentication is important, though not a complete defense. Rate-limiting policies add an extra line of protection to reduce the impact on compromised APIs.

April 29, 2024

by Hugo Guerrero

CORE

· 1,182 Views · 1 Like

Uber's Success With Apache Pinot: Cost Savings and Performance Boost

Uber migrated from Elasticsearch to Apache Pinot and saw a 70% reduction in costs, an 80% reduction in CPU cores, and a decrease in page load times and query timeouts.

April 29, 2024

by Kristin Crosier

· 1,434 Views · 3 Likes

How To Create Auto Scaling in AWS

This blog post will help you create Auto Scaling in AWS, a collection of Amazon Ec2 instances with similar characteristics among them in just a group.

April 29, 2024

by Alfonso Valdes

· 1,210 Views · 1 Like

Gain Lightning Fast Reads and Writes Without Changing Your PostgreSQL Application

Walk through how the YugabyteDB distributed database lowers read and write latency and (most importantly) runs an existing PostgreSQL application with no costly rewrite.

April 29, 2024

by Jim Knicely

· 846 Views · 1 Like

Multiplatform Directory Bookmarks on the Command Line

This article discusses how to manage directory bookmarks on the command line for efficient use of the character terminal.

April 29, 2024

by Pavel Ponec

· 1,118 Views · 1 Like

The Latest Data Engineering Topics