Data Engineering Resources

Requirements, Code, and Tests: How Venn Diagrams Can Explain It All

This article explains how requirements, code, and tests are interconnected, using Venn diagrams as a visual aid.

February 5, 2024

by Stelios Manioudakis

CORE

· 6,280 Views · 4 Likes

Building and Deploying a Chatbot With Google Cloud Run and Dialogflow

Learn to build and deploy a chatbot using Dialogflow and Google Cloud Run for dynamic, scalable user interactions.

February 5, 2024

by Ashok Gorantla

CORE

· 15,746 Views · 5 Likes

Unlocking the Power Duo: Kafka and ClickHouse for Lightning-Fast Data Processing

Explore integration strategies for Kafka and ClickHouse, focusing on various methodologies like Kafka Engine, Kafka Connect, DoubleCloud Transfer, and ClickPipes.

February 5, 2024

by Andrei Tserakhau

· 4,151 Views · 1 Like

Developing Intelligent and Relevant Software Applications Through the Utilization of AI and ML Technologies

This article explains how AI and ML can enhance software performance by providing intelligent functionalities.

February 5, 2024

by Sumit Sanwal

· 3,335 Views · 2 Likes

Mastering Concurrency: An In-Depth Guide to Java's ExecutorService

Java's ExecutorService is a powerful framework for managing and executing concurrent tasks in Java applications. It provides a higher-level abstraction over raw threads.

February 5, 2024

by Andrei Tuchin

CORE

· 10,615 Views · 6 Likes

Data Lineage in Modern Data Engineering

Data lineage is a critical aspect of data engineering that often plays a pivotal role in ensuring data quality, traceability, and compliance.

February 5, 2024

by Kshitiz Jain

· 3,880 Views · 1 Like

Effective Log Data Analysis With Amazon CloudWatch: Harnessing Machine Learning

The article explains how CloudWatch effectively handles key challenges in log data analysis, emphasizing volume management and anomaly detection.

February 5, 2024

by Rajat Gupta

· 5,936 Views · 12 Likes

Low-Code/No-Code Platforms: Seven Ways They Empower Developers

Low and no-code platforms can make the development process faster through automation, leading to higher business growth.

February 5, 2024

by Syed Balkhi

· 3,818 Views · 1 Like

Building a Simple gRPC Service in Go

This post starts with the basics of building a gRPC service in Go, including tooling, best practices, and design considerations.

February 5, 2024

by Sriram Panyam

· 3,406 Views · 2 Likes

Empowering Developers With Data in the Age of Platform Engineering

Enterprises like Dell, TD Bank, and FreedomPay are leveraging observability and AI to boost developer productivity and deliver a premium and reliable CX.

February 5, 2024

by Tom Smith

CORE

· 3,647 Views · 1 Like

GenAI in Data Engineering Beyond Text Generation

In data engineering, GenAI — particularly ChatGPT — is showcasing its potential to drive innovation, efficiency, and intelligence in data-centric operations.

February 4, 2024

by Deepak Jayabalan

· 3,972 Views · 3 Likes

AWS SageMaker vs. Google Cloud AI: Unveiling the Powerhouses of Machine Learning

This article provides a comprehensive comparison of AWS SageMaker and Google Cloud AI, dissecting the strengths and capabilities of each.

February 4, 2024

by Saikrishna Chinthapatla

· 5,059 Views · 2 Likes

AIOps Now: Scaling Kubernetes With AI and Machine Learning

Using AI and digital twins, optimize Kubernetes apps and address SRE challenges with continuous learning for improved outcomes.

February 4, 2024

by Raj Nair

· 6,078 Views · 1 Like

Oracle Cloud Infrastructure: A Comprehensive Suite of Cloud Services

In this article, we will explore the key cloud services provided by Oracle Cloud Infrastructure and their benefits for businesses.

February 4, 2024

by Aditya Bhuyan

· 3,239 Views · 2 Likes

WebRTC vs. RTSP: Understanding the IoT Video Streaming Protocols

With video surveillance booming, WebRTC and RTSP meet diverse streaming needs in IoT. Let's discuss the basics and benefits of each protocol.

February 3, 2024

by Carsten Rhod Gregersen

· 9,456 Views · 1 Like

The Future Is Cloud-Native: Are You Ready?

Embrace the next generation of application development with cloud-native architecture.

February 3, 2024

by Gaurav Gaur

CORE

· 4,967 Views · 3 Likes

Software-Defined Networking in Distributed Systems: Transforming Data Centers and Cloud Computing Environments

This article delves into the pivotal role SDN plays in enhancing distributed systems' efficiency, agility, and scalability. Explore its impact on data centers and cloud computing environments, unraveling key components and addressing challenges.

February 3, 2024

by Aditya Bhuyan

· 4,140 Views · 2 Likes

Implementation of the Raft Consensus Algorithm Using C++20 Coroutines

Detailed implementation of Raft consensus using C++20 coroutines, emphasizing algorithmic challenges and a specialized network library.

February 2, 2024

by Aleksei Ozeritskii

· 14,913 Views · 2 Likes

Edge Computing Orchestration in IoT: Coordinating Distributed Workloads

In IoT, edge computing orchestration uses AI to coordinate tasks across devices. Benefits include real-time decisions, resource efficiency, and scalability.

February 2, 2024

by Deep Manishkumar Dave

· 6,147 Views · 1 Like

Simplifying Data Management for Technology Teams With HYCU

HYCU and Anthropic launched a pioneering collaboration for generative AI-powered unified data management across on-premise, multi-cloud, and SaaS.

February 2, 2024

by Tom Smith

CORE

· 5,282 Views · 1 Like

The Latest Data Engineering Topics