Data Engineering Resources

Semi-Supervised Learning: How to Overcome the Lack of Labels

Dive into the concept of semi-supervised learning and explore its principles, applications, and potential to revolutionize how we approach data-hungry ML tasks.

August 7, 2024

by Aleksandr Timashov

· 38,108 Views · 49 Likes

10 Kubernetes Cost Optimization Techniques

In this article, learn 10 ways to drive down Kubernetes costs, whether you are adopting a new architecture or optimizing an existing environment.

August 7, 2024

by Andromeda Booth

· 8,282 Views · 4 Likes

Introduction to Salesforce Batch Apex [Video]

Explore core concepts and practical applications of Batch Apex in Salesforce, including the structure, how to write unit tests, scheduling, and more.

August 7, 2024

by Dino Scarcella

· 3,382 Views · 1 Like

SQL Interview Preparation Series: Mastering Questions and Answers Quickly

Learn about SQL vs NoSQL, data integrity, and scalability, and prepare for common SQL and NoSQL interview questions.

August 7, 2024

by Sia L.

· 4,069 Views · 1 Like

Enhancing Java Application Logging: A Comprehensive Guide

Learn Java logging best practices: use proper log levels, include unique IDs for trackability, and secure logs to avoid sensitive data exposure.

August 7, 2024

by Otavio Santana

CORE

· 7,849 Views · 9 Likes

Enhancing Agile Product Development With AI and LLMs

AI and LLMs streamline user story creation, optimize backlog, and predict trends, improving agile product development speed, relevance, and user engagement.

August 7, 2024

by Varun Milind Kulkarni

· 4,428 Views · 4 Likes

How to Create and Run A Job In Jenkins Using Jenkins Freestyle Project

Learn how to create a job in Jenkins, build jobs, and pipeline projects. Explore the Jenkins Freestyle Project, and combine any SCM with any build system.

August 7, 2024

by Piyusha Podutwar

· 5,958 Views · 1 Like

extended Berkeley Packet Filter (eBPF) for Cloud Computing

Explore eBPF, a technology that executes codes in the Linux kernel and is necessary for K8s network observability/monitoring, auditing, and traffic routing.

August 7, 2024

by Gaurav Shekhar

· 7,109 Views · 3 Likes

JMeter Plugin HTTP Simple Table Server (STS) In-Depth

Take an in-depth look to discover some of the possibilities of using the HTTP Simple Table Server a JMeter Plugin in this short manual.

August 6, 2024

by Vincent DABURON

· 3,528 Views · 3 Likes

Why You Should Use Buildpacks Over Docker

Learn why you should consider using Buildpacks to improve your container workflow, from automated dependency management to enhanced security and optimization.

August 6, 2024

by Sylvain Kalache

· 11,658 Views · 5 Likes

Building an LLM-Powered Product to Learn the AI Stack: Part 1

Building a Meal Planning Bot to Deep Dive into LLMs, Product Development, and Cloud Skills. From Data Generation, to Model Training, to Deployment and App building

August 6, 2024

by Indrajit Bhattacharya

· 5,222 Views · 10 Likes

Handling Schema Versioning and Updates in Event Streaming Platforms Without Schema Registries

Learn how to handle schema versioning and updates in Kafka and other event streaming platforms without using schema registries through custom deserializers.

August 6, 2024

by Sanket Panhale

· 10,420 Views · 1 Like

Oracle: Migrate PDB to Another Database

Explore different approaches to move the pluggable database from source to target database such as plug/unplug, data pump, refreshable clone and DBCA relocate.

August 6, 2024

by Deval Parikh

· 3,751 Views · 2 Likes

Develop With OCI Real-Time Speech Transcription and Oracle Database NL2SQL/Select AI To Speak With Your Data

Use a combination of real-time speech-to-text, natural language to SQL, and Gen AI, to talk with your data just as you would to a person and in real-time.

August 6, 2024

by Paul Parkinson

· 2,394 Views · 3 Likes

Idempotency in Data Pipelines: Overview

Idempotency is an important concept in data engineering, particularly when working with distributed systems or databases. Learn more here.

August 6, 2024

by Harsh Daiya

CORE

· 2,889 Views · 4 Likes

Go Serverless: Unleash Next-Gen Computing

Learn how serverless architecture, with its event-driven architecture, auto-scaling ability, and security walls, frees devs from infrastructure management woes.

August 5, 2024

by Aditya Kumar

· 5,540 Views · 3 Likes

Scaling Prometheus With Thanos

Learn how to scale Prometheus using Thanos for long-term storage, global view metrics, and improved performance in large-scale Kubernetes environments.

August 5, 2024

by Ritesh Sonawane

· 3,044 Views · 5 Likes

Reimagining AI: Ensuring Trust, Security, and Ethical Use

How can we trust AI in our daily lives? Explore the balance between innovation and safety in the age of intelligent systems.

August 5, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,346 Views · 2 Likes

Building an IoT-based Waste Management System: A Software Architect's Guide

Explore how IoT waste management optimizes collection, reduces costs, and enhances sustainability using smart bins, mobile apps, and analytics.

August 5, 2024

by Arun Pandey

CORE

· 4,234 Views · 2 Likes

Streaming Data Joins: A Deep Dive Into Real-Time Data Enrichment

Unravel the complexities of streaming data joins in this guide covering key concepts, design, and best practices for optimal real-time data enrichment.

August 5, 2024

by Preet Shah

· 3,542 Views · 4 Likes

The Latest Data Engineering Topics