IoT Resources

Batch vs. Real-Time Processing: Understanding the Differences

Learn the differences between batch and real-time data processing, and explore the decision-making factors for choosing the right approach to optimize data pipelines.

August 8, 2024

by Stelios Manioudakis

CORE

· 17,658 Views · 4 Likes

extended Berkeley Packet Filter (eBPF) for Cloud Computing

Explore eBPF, a technology that executes codes in the Linux kernel and is necessary for K8s network observability/monitoring, auditing, and traffic routing.

August 7, 2024

by Gaurav Shekhar

· 17,493 Views · 3 Likes

Building an IoT-based Waste Management System: A Software Architect's Guide

Explore how IoT waste management optimizes collection, reduces costs, and enhances sustainability using smart bins, mobile apps, and analytics.

August 5, 2024

by Arun Pandey

CORE

· 6,569 Views · 3 Likes

Upgrading Spark Pipelines Code: A Comprehensive Guide

Discuss the strategic importance of Spark code upgrades and explore an introduction to a powerful toolkit designed to streamline this process: Scalafix.

August 5, 2024

by Suri (thammuio)

CORE

· 26,287 Views · 2 Likes

Industrial IoT: Exploring Microcontrollers for Robust Applications

Let's explore the features, applications, and top choices for microcontrollers in industrial IoT, achieving reliability, efficiency, and security in harsh environments.

August 2, 2024

by Carsten Rhod Gregersen

· 5,677 Views · 2 Likes

Criticality in Data Stream Processing and a Few Effective Approaches

Opposite to traditional batch data processing technique, here processing works on the data as it is produced in real-time. Learn more in this post.

August 2, 2024

by Gautam Goswami

CORE

· 6,115 Views · 2 Likes

How to Run Apache Spark on Kubernetes in Less Than 5 Minutes

Learn how to quickly set up and run Apache Spark on Kubernetes using Ilum for easier deployment, management, and scaling.

July 30, 2024

by Adam Lichtenstein

· 10,278 Views · 11 Likes

Enhancing Stream Data Processing With Snow Pipe, Cortex AI, and Snow Park

Customer sentiment analysis from reviews gathered from external source streams is ingested to Snowflake using Snow Pipe for further analysis using cortex AI API’s.

July 30, 2024

by Harshavardhan Yedla

· 3,815 Views · 3 Likes

How Kubernetes Changed the Networking Model and What Developers Should Know about eBPF and Cilium

Explore how Kubernetes transformed networking, the impact of eBPF and Cilium, and the future of network administration in this interview with Nicolas Vibert.

July 30, 2024

by Tom Smith

CORE

· 16,892 Views · 5 Likes

Pilot VPC and Advanced NAT: Securely Connect Overlapping Networks to AWS VPC

This article introduces a new method for creating secure connections between overlapping on-premise networks and Amazon VPC via a site-to-site VPN.

July 25, 2024

by Narinder Singh Kharbanda

· 5,970 Views · 3 Likes

Snowflake Integration Patterns: Apache Kafka vs. Zero ETL and Reverse ETL

Integration patterns for cloud-native Snowflake data warehouse: Batch data, Zero ETL, Reverse ETL, Real-time data ingestion with Apache Kafka.

July 24, 2024

by Kai Wähner

CORE

· 6,791 Views · 3 Likes

Building Your Own IoT Project: A Step-By-Step Guide

This guide will walk you through the essential steps to build your first IoT project, ensuring you have a solid foundation to explore this fascinating field.

July 22, 2024

by Sachin Reddy

· 10,288 Views · 4 Likes

When Not to Choose Google Apache Kafka for BigQuery

When not to choose Google Apache Kafka for BigQuery — a review, comparison with Confluent Cloud, and data streaming landscape outlook.

July 16, 2024

by Kai Wähner

CORE

· 5,317 Views · 2 Likes

Mitigate the Security Challenges of Telecom 5G IoT Microservice Pods Architecture Using Istio

Discover the essential features of Istio Service Mesh Architecture and master the configuration of Istio for cellular IoT Microservices pods.

July 9, 2024

by BINU SUDHAKARAN PILLAI

· 19,191 Views · 5 Likes

Step-By-Step Guide: Configuring IPsec Over SD-WAN on FortiGate and Unveiling Its Benefits

This article outlines the steps for implementing IPSec over SD-WAN and its advantages, and use cases in today's modern network with a focus on security.

July 5, 2024

by Sanjay Poddar

· 21,871 Views · 24 Likes

Understanding Properties of Zero Trust Networks

A practical guide to exploring in detail the "Security Automation" property of Zero Trust Networks, by looking at scenarios, technology stack, and examples.

July 3, 2024

by Abhishek Goswami

· 3,806 Views · 2 Likes

Apache Hudi: A Deep Dive With Python Code Examples

Explore Apache Hudi, an open-source data management framework providing efficient data ingestion and real-time analytics on large-scale datasets stored in data lakes.

July 2, 2024

by Harsh Daiya

CORE

· 4,857 Views · 3 Likes

Data Processing vs. Process Management vs. AI?

Modern process management can help to build the bridge between data processing and Large Language Models (LLMs) in a data-driven business landscape.

June 25, 2024

by Ralph Soika

· 3,728 Views · 1 Like

When Not To Use Apache Kafka (Lightboard Video)

When not to use Apache Kafka, do's and don't's; no matter if you use open source, Confluent, Amazon MSK, Event Hubs, Redpanda, Warpstream, et al.

June 25, 2024

by Kai Wähner

CORE

· 3,181 Views · 1 Like

MaxLinear Empowers High-Speed Connectivity and Data Acceleration Solutions for Next-Gen Computing

Advanced connectivity solutions and Panther III storage accelerator empower software engineers to build high-performance, data-driven computing systems.

June 22, 2024

by Tom Smith

CORE

· 4,201 Views · 1 Like

The Latest IoT Topics