Data Engineering Resources

Designing Communication Architectures With Microservices

Communication between microservices should be robust and efficient.

April 30, 2024

by Swathi Prasad

· 4,694 Views · 5 Likes

AI-Driven Development: Maximizing Efficiency With GitHub Copilot and Seamless Chat Collaboration in Visual Studio IDE

GitHub Copilot AI assistant speeds up development by providing automatic code completions, suggestions, and many more that enhance developer's productivity.

April 30, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 2,580 Views · 3 Likes

AI Is BS Spelled AI

What is AI? In this opinion piece, follow along with the discussion of whether artificial intelligence or virtual assistance is the end goal.

April 29, 2024

by Greg Hall

· 1,168 Views · 1 Like

Implementing RSA From Scratch in Python (Part 2)

In Part 2 of this Python series, explore a discussion about Random Prime Numbers and the Fibonacci Number Calculation when implementing RSA from scratch.

April 29, 2024

by Traven West

· 1,365 Views · 1 Like

Develop XR With Oracle, Ep 7: Teleport Live 3D Objects From Ray-Bans to Magic Leap, Quest, Vision Pro, and 3D Printers

Share live 3D objects captured with Ray-Bans with XR (AR, VR, or MR) and/or 3D printers with a similar experience as what exists today for 2D pictures/printers.

April 29, 2024

by Paul Parkinson

· 4,039 Views · 2 Likes

When APIs Go Wrong: Neglecting Rate Limiting

Authentication is important, though not a complete defense. Rate-limiting policies add an extra line of protection to reduce the impact on compromised APIs.

April 29, 2024

by Hugo Guerrero

CORE

· 2,230 Views · 1 Like

Uber's Success With Apache Pinot: Cost Savings and Performance Boost

Uber migrated from Elasticsearch to Apache Pinot and saw a 70% reduction in costs, an 80% reduction in CPU cores, and a decrease in page load times and query timeouts.

April 29, 2024

by Kristin Crosier

· 1,924 Views · 3 Likes

How To Create Auto Scaling in AWS

This blog post will help you create Auto Scaling in AWS, a collection of Amazon Ec2 instances with similar characteristics among them in just a group.

April 29, 2024

by Alfonso Valdes

· 2,109 Views · 1 Like

Gain Lightning Fast Reads and Writes Without Changing Your PostgreSQL Application

Walk through how the YugabyteDB distributed database lowers read and write latency and (most importantly) runs an existing PostgreSQL application with no costly rewrite.

April 29, 2024

by Jim Knicely

· 1,223 Views · 1 Like

Multiplatform Directory Bookmarks on the Command Line

This article discusses how to manage directory bookmarks on the command line for efficient use of the character terminal.

April 29, 2024

by Pavel Ponec

· 2,388 Views · 1 Like

Adjusting Data Before Sending It to Kentik NMS

Sometimes, you want to modify data before displaying it in your network monitoring system. So strap in and let’s get mathy!

April 29, 2024

by Leon Adato

· 1,560 Views · 1 Like

Why Cloud Native Is Vital to Your Organization's APIs: The Impact Could Be More Than Expected

As your API infrastructure expands, a cloud-native design provides the necessary tooling to ease supportability and manageability efforts.

April 29, 2024

by John Vester

CORE

· 59,171 Views · 2 Likes

The Simplest Ingredient for Developing Real-Time Front-End Applications

How to build a real-time frontend application using Redpanda Serverless, Pusher, and Vercel. Managing streaming data, and setting up real-time communication channels.

April 29, 2024

by Christina Lin

CORE

· 4,843 Views · 4 Likes

How To Use Retrieval Augmented Generation (RAG) for Go Applications

In this article, learn how to implement RAG (using LangChain and PostgreSQL) to improve the accuracy and relevance of LLM outputs.

April 29, 2024

by Abhishek Gupta

CORE

· 3,494 Views · 2 Likes

New All-Flash Solutions To Streamline Data Management for AI and High-Volume Workloads

Quantum's all-flash solutions simplify data management for AI and high-volume workloads, offering high-performance storage and seamless integration.

April 29, 2024

by Tom Smith

CORE

· 2,050 Views · 1 Like

Turbocharge Innovation With Automated API Generation: Leveraging Automated API Generation for a Competitive Advantage

Amplify the potential of generative AI and low- and no-code platforms in API generation by highlighting their roles in fostering innovation and expediting time to market.

April 28, 2024

by Pratik Prakash

CORE

· 4,101 Views · 4 Likes

Get Some Rest! A Full API Stack

Explore options for building an API tech stack — from initial API design and documentation to API development, lifecycle management, security, monitoring, and more.

April 27, 2024

by Thomas Jardinet

CORE

· 5,152 Views · 7 Likes

Revisiting Observability: A Deep Dive Into the State of Monitoring, Costs, and Data Ownership in Today’s Market

Explore insights into the current challenges in monitoring, highlighting issues with instrumentation, pricing models, and data ownership.

April 26, 2024

by Mike Moore

· 2,984 Views · 3 Likes

Kubernetes: Future or Fad?

I don't think Kubernetes is yet another fad, but I strongly hope it's not going to be our future either. At least not in its current incarnation.

April 26, 2024

by Christoph Engelbert

· 2,815 Views · 2 Likes

Solving PostgreSQL Indexes, Partitioning, and LockManager Limitations

Read this blog to learn how to avoid the scalability limitations of PostgreSQL's partition-based approach by leveraging automatic sharding and global indexing.

April 26, 2024

by Franck Pachot

· 1,709 Views · 1 Like

The Latest Data Engineering Topics