Data Engineering Resources

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 6,371 Views · 1 Like

Demystifying the Magic: A Look Inside the Algorithms of Speech Recognition

Discover the mechanics that make speech recognition possible. Understanding the increasingly common voice-user interface (VUI) for applied AI could give you an edge.

August 9, 2024

by Manoj Boopathi Raj

· 4,761 Views · 1 Like

Why I Use RTK Query for API Calls in React

This article shares the architectural decisions, trade-offs, and lessons learned from building a system where every order triggers a multi-variable matching decision

August 9, 2024

by Bilal Azam

· 6,710 Views · 2 Likes

Use Mistral AI to Build Generative AI Applications With Go

Let's walk through how to use these Mistral AI models on Amazon Bedrock with Go, and in the process, also get a better understanding of its prompt tokens.

August 9, 2024

by Abhishek Gupta

CORE

· 6,193 Views · 1 Like

Content Detection Technologies in Data Loss Prevention (DLP) Products

Explore the key content detection technologies needed in a Data Loss Prevention (DLP) product developers need to focus on to develop a first-class solution.

August 9, 2024

by Priyanka Neelakrishnan

· 15,538 Views · 2 Likes

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 5,946 Views · 1 Like

The Case for Working on Non-Glamorous Migration Projects

Explore this contrary take on how to accelerate your journey to become a battle-hardened software developer/leader.

August 8, 2024

by Tejas Ghadge

· 17,869 Views · 7 Likes

Batch vs. Real-Time Processing: Understanding the Differences

Learn the differences between batch and real-time data processing, and explore the decision-making factors for choosing the right approach to optimize data pipelines.

August 8, 2024

by Stelios Manioudakis

CORE

· 17,221 Views · 3 Likes

Apache Flink 101: A Guide for Developers

Learn more about Apache Flink, a powerful stream processing tool, for building streaming data pipelines, real-time analytics, and event-driven applications.

August 8, 2024

by David Anderson

· 9,644 Views · 2 Likes

How to Create a CRUD Application in Less Than 15 Minutes

This step-by-step guide explores how to create a front end for your database with Java only, without any JavaScript knowledge needed.

August 8, 2024

by Amir Shelli

· 18,657 Views · 8 Likes

Running PyTorch on GPUs

This summary of steps to run the PyTorch framework or any AI workload on GPUs highlights the importance of the hardware, driver, software, and frameworks.

August 8, 2024

by Jagadish Krishnamoorthy

· 8,116 Views · 2 Likes

How to Scale RAG and Build More Accurate LLMs

Retrieval augmented generation (RAG) needs the right data architecture to scale efficiently. Learn how data streaming helps data and application teams innovate.

August 8, 2024

by Andrew Sellers

· 3,734 Views · 2 Likes

Leveraging Snowflake’s AI/ML Capabilities for Anomaly Detection

Explore the AI/ML capabilities of Snowflake, focusing on leveraging the SNOWFLAKE.ML.ANOMALY_DETECTION function to detect anomalies in superstore sales.

August 8, 2024

by Kapil Kumar Sharma

· 5,731 Views · 1 Like

Semi-Supervised Learning: How to Overcome the Lack of Labels

Dive into the concept of semi-supervised learning and explore its principles, applications, and potential to revolutionize how we approach data-hungry ML tasks.

August 7, 2024

by Aleksandr Timashov

· 41,075 Views · 49 Likes

10 Kubernetes Cost Optimization Techniques

In this article, learn 10 ways to drive down Kubernetes costs, whether you are adopting a new architecture or optimizing an existing environment.

August 7, 2024

by Andromeda Booth

· 9,680 Views · 5 Likes

Introduction to Salesforce Batch Apex [Video]

Explore core concepts and practical applications of Batch Apex in Salesforce, including the structure, how to write unit tests, scheduling, and more.

August 7, 2024

by Dino Scarcella

· 4,725 Views · 1 Like

SQL Interview Preparation Series: Mastering Questions and Answers Quickly

Learn about SQL vs NoSQL, data integrity, and scalability, and prepare for common SQL and NoSQL interview questions.

August 7, 2024

by Sia L.

· 5,571 Views · 1 Like

Enhancing Java Application Logging: A Comprehensive Guide

Learn Java logging best practices: use proper log levels, include unique IDs for trackability, and secure logs to avoid sensitive data exposure.

August 7, 2024

by Otavio Santana

CORE

· 11,633 Views · 9 Likes

Enhancing Agile Product Development With AI and LLMs

AI and LLMs streamline user story creation, optimize backlog, and predict trends, improving agile product development speed, relevance, and user engagement.

August 7, 2024

by Varun Milind Kulkarni

· 7,571 Views · 4 Likes

How to Create and Run A Job In Jenkins Using Jenkins Freestyle Project

Learn how to create a job in Jenkins, build jobs, and pipeline projects. Explore the Jenkins Freestyle Project, and combine any SCM with any build system.

August 7, 2024

by Piyusha Podutwar

· 6,810 Views · 1 Like

The Latest Data Engineering Topics