Big Data Resources

Uber's Success With Apache Pinot: Cost Savings and Performance Boost

Uber migrated from Elasticsearch to Apache Pinot and saw a 70% reduction in costs, an 80% reduction in CPU cores, and a decrease in page load times and query timeouts.

April 29, 2024

by Kristin Crosier

· 1,931 Views · 3 Likes

The Simplest Ingredient for Developing Real-Time Front-End Applications

How to build a real-time frontend application using Redpanda Serverless, Pusher, and Vercel. Managing streaming data, and setting up real-time communication channels.

April 29, 2024

by Christina Lin

CORE

· 4,865 Views · 4 Likes

Revisiting Observability: A Deep Dive Into the State of Monitoring, Costs, and Data Ownership in Today’s Market

Explore insights into the current challenges in monitoring, highlighting issues with instrumentation, pricing models, and data ownership.

April 26, 2024

by Mike Moore

· 3,033 Views · 3 Likes

A Complete Guide to the Real-Time Streaming Protocol (RTSP)

RTSP enables control of media streaming sessions for IoT video applications like surveillance cameras. Here's everything you need to know.

April 25, 2024

by Carsten Rhod Gregersen

· 3,100 Views · 4 Likes

Java Container Application Memory Analysis

In this article, I cover types of memory usage for a Java container application and methods to analyze memory consumption.

April 24, 2024

by Parveen Saini

· 3,023 Views · 2 Likes

Starburst Unveils Fully Managed 'Icehouse' for Near Real-Time Analytics on the Open Data Lakehouse

Icehouse on Galaxy simplifies data analytics, reduces costs, and enables AI/ML workloads with an open data lakehouse architecture.

April 24, 2024

by Tom Smith

CORE

· 2,394 Views · 2 Likes

The Importance of Understanding Time Complexity in Data Structures

Why mastering time complexity is crucial, particularly in the context of data structures, and how it influences the performance and scalability of applications.

April 23, 2024

by Michael Johnson

· 120,836 Views · 78 Likes

Storage Systems For Real-Time Personalized Recommendations

Recommendation systems personalize content with machine learning, boosting engagement. They need fast, scalable storage to handle big, changing datasets.

April 23, 2024

by Jayasekhar Konduru

· 2,638 Views · 2 Likes

Introduction to Modern AI 2024 Edition, Part 2

In this post, walk through a real-life business problem and make use of ChatGPT with Advanced Data Analysis to help with the solution.

April 19, 2024

by Joel Nylund

CORE

· 1,881 Views · 3 Likes

How to Really Build a GraphQL Server With Java

This tutorial aims to demonstrate the process of building a GraphQL server utilizing the venerable graphql-java library in Java.

April 18, 2024

by David Ventimiglia

· 4,071 Views · 5 Likes

Vector Databases: Unlocking New Dimensions in Video Streaming

Explore how vector embeddings and machine learning transform search capabilities in streaming platforms and enhance user discovery and personalization.

April 15, 2024

by Sai Mahesh vuppalapati

· 5,720 Views · 6 Likes

Real-Time Data Transfer from Apache Flink to Kafka to Druid for Analysis/Decision-Making

In this article, follow an outline of the steps to transfer processed data from Flink 1.18.1 to a Kafka 2.13-3.7.0 topic.

April 15, 2024

by Gautam Goswami

CORE

· 2,878 Views · 2 Likes

AI Frameworks for Software Engineers: TensorFlow (Part 1)

TensorFlow, a key AI framework, enables the building, training, and deploying of versatile AI models, illustrated through a simple example.

April 3, 2024

by Amardeep Singh

· 5,707 Views · 7 Likes

Ethics in the Age of AI: The Human and Moral Impact of AI

Generative AI and LLMs have ever-expanding use cases, but they also have the potential for misuse, raising fundamental questions regarding AI's human and ethical impact.

April 3, 2024

by Cate Lawrence

CORE

· 4,900 Views · 3 Likes

Optimize Data Warehouse Migration Efforts by Factor of 50

This paper outlines the challenges encountered during the migration of a large data warehouse and how these challenges were tackled through innovative solutions.

April 3, 2024

by Vaibhav Dantale

· 16,846 Views · 3 Likes

Efficient Ticket Management Using LangChain and Large Language Models

LangChain agents, powered by ChatGPT, revolutionize JIRA ticket creation for seamless cross-team collaboration, boosting efficiency and productivity.

April 3, 2024

by Rupali Kaushik

· 8,740 Views · 5 Likes

Data Lake vs. Data Warehouse

Data lakes offer flexibility with raw data; data warehouses provide structured data for quick insights. Each has its own benefits and trade-offs.

April 2, 2024

by Pier-Jean MALANDRINO

CORE

· 1,592 Views · 3 Likes

Node-RED Unleashed: Transforming Industrial IoT Development and Industry Collaboration With Hitachi

Hear from Hitachi's Kazuhito Yokoi to find out more about Node-RED and why it is becoming so popular in Industrial IoT applications.

April 2, 2024

by Jesse Casman

CORE

· 10,966 Views · 7 Likes

Snowflake Micro-Partitioning: Technical Insights, Examples, and Advanced Developer Guide

Snowflake micro-partitioning boosts query performance, scalability, and storage efficiency with advanced developer tactics.

April 2, 2024

by Arun Pandey

CORE

· 12,780 Views · 2 Likes

Navigating the Data Landscape: A Guide for Developers, Engineers, and Architects

Understand the roles of data analysts, engineers, and scientists. Learn how they collaborate and what to consider for a career in data insights for devs and IT pros.

April 2, 2024

by Tom Smith

CORE

· 2,141 Views · 1 Like

The Latest Big Data Topics