Data Engineering Resources

In this article, we'll explore how users more comfortable with dataframes can work with their Big Data in Couchbase's Analytics Service.

May 2, 2024

by Glenn Galvizo

· 1,878 Views · 1 Like

How To Fix Kafka Consumers Due To Corrupted Log Files or Missing Log Files

This article explores recovering Kafka Brokers from corrupted data storage and recovering Kafka consumers due to missing log files.

May 2, 2024

by Ramu kakarla

· 5,543 Views · 1 Like

Understanding Gen AI: RAG Implementation

RAG is a technique to use existing LLMs to generate contextual responses with proprietary data, without the need to retrain the LLMs, offering a cost-effective solution.

May 2, 2024

by Ganesh Kumar Murugesan

· 3,510 Views · 2 Likes

Five Ways To Pass Parameters to Apache APISIX

This article explores all the ways to send parameters to Apache APISIX, which is beneficial when you write a custom plugin.

May 2, 2024

by Nicolas Fränkel

· 2,190 Views · 1 Like

Navigating Cloud-Native Components: Using Service Registry and Definitions

Explore the service registry and service definitions, which are crucial components in cloud-native architecture for efficient, reliable, and scalable applications.

May 2, 2024

by Gaurav Gaur

CORE

· 2,044 Views · 4 Likes

Exploring FAPI 2.0: The Latest in API Security Technology

This post explores FAPI standards, which enhance secure data exchange in high-risk sectors, evolving from OAuth 2.0-based FAPI 1.0 to the more secure FAPI 2.0.

May 1, 2024

by Hideki Ikeda

· 2,641 Views · 2 Likes

Data Warehouse for Data Science: Adopting Arrow Flight SQL for 10X Data Transfer

Apache Doris 2.1 supports Arrow Flight SQL protocol for reading data from Doris. It delivers tenfold speedups compared to PyMySQL and Pandas.

May 1, 2024

by Shirley H.

· 1,869 Views · 2 Likes

Reliability Models and Metrics for Test Engineering

Explore how reliability models and metrics help identify potential weak spots, anticipate failures, and build better products.

May 1, 2024

by Stelios Manioudakis

CORE

· 6,833 Views · 4 Likes

An Introduction to Stream Processing

As a gentle introduction to stream processing, we’ve defined what it is, how it differs from batch processing, and how computation works in stream processing.

May 1, 2024

by Federico Trotta

· 4,056 Views · 5 Likes

API-Based Web Service as Serverless Function

Serverless architecture is a method of decoupling server maintenance, scalability, and availability from the development process.

May 1, 2024

by Madhan Muralimanohar

· 1,830 Views · 1 Like

Files and Exceptions in Python

Exceptions are special objects that Python uses to manage errors that occur when a program is running. Here, learn to work with files and handle exceptions.

April 30, 2024

by Duncan Ndegwa

· 1,692 Views · 2 Likes

The Evolution of Platform Extensibility

From API to AI, this article attempts to capture the state of extensibility and charts a course for what the future might hold.

April 30, 2024

by Ashwin Ganesh Krishnamurthy

· 1,522 Views · 1 Like

Exploration of Azure OpenAI

Follow an overview of Azure Open AI and its significance in the field of artificial intelligence, learning how to build intelligent applications.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 2,445 Views · 3 Likes

Expose Your Database as a REST API Safely and Without Code

DB2Rest is open-source middleware that offers a no-code way to safely expose data from your database for your applications to consume.

April 30, 2024

by Thad Guidry

· 2,799 Views · 2 Likes

Designing Communication Architectures With Microservices

Communication between microservices should be robust and efficient.

April 30, 2024

by Swathi Prasad

· 4,542 Views · 5 Likes

AI-Driven Development: Maximizing Efficiency With GitHub Copilot and Seamless Chat Collaboration in Visual Studio IDE

GitHub Copilot AI assistant speeds up development by providing automatic code completions, suggestions, and many more that enhance developer's productivity.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 2,432 Views · 3 Likes

AI Is BS Spelled AI

What is AI? In this opinion piece, follow along with the discussion of whether artificial intelligence or virtual assistance is the end goal.

April 29, 2024

by Greg Hall

· 1,104 Views · 1 Like

Implementing RSA From Scratch in Python (Part 2)

In Part 2 of this Python series, explore a discussion about Random Prime Numbers and the Fibonacci Number Calculation when implementing RSA from scratch.

April 29, 2024

by Traven West

· 1,222 Views · 1 Like

Develop XR With Oracle, Ep 7: Teleport Live 3D Objects From Ray-Bans to Magic Leap, Quest, Vision Pro, and 3D Printers

Share live 3D objects captured with Ray-Bans with XR (AR, VR, or MR) and/or 3D printers with a similar experience as what exists today for 2D pictures/printers.

April 29, 2024

by Paul Parkinson

· 3,861 Views · 2 Likes

When APIs Go Wrong: Neglecting Rate Limiting

Authentication is important, though not a complete defense. Rate-limiting policies add an extra line of protection to reduce the impact on compromised APIs.

April 29, 2024

by Hugo Guerrero

CORE

· 2,097 Views · 1 Like

The Latest Data Engineering Topics