Data Engineering Resources

Building a Real-Time Alerting Solution With Zero Code

How cloud services can be leveraged to easily build a solution that allows you to define custom rules to trigger a notification.

August 7, 2023

by Siddarth Ramadoss

· 5,444 Views · 5 Likes

Variations With Stable Diffusion Depth2Img: A Step-By-Step Guide

A beginner's guide to preserving shape and depth in AI-Generated art, using Stable Diffusion Depth2Img and Node.js

August 7, 2023

by Mike Young

· 1,484 Views · 1 Like

Game Day: Stress-Testing Our Response Systems and Processes

By running Game Days, we can meaningfully improve the way we respond to more significant, more complex incidents.

August 7, 2023

by Rory Bain

· 1,718 Views · 1 Like

Simplified Development With Azure DevOps

Azure DevOps streamlines software development by enabling cloud-based collaboration, automation, and real-time cooperation to increase efficiency and foster innovation.

August 7, 2023

by Samir Hazra

· 4,421 Views · 1 Like

System Architecture: Move Authentication to the API Gateway

When exposing an application to the outside world, consider a Reverse-Proxy or an API Gateway to protect it from attacks. Rate limiting comes to mind first, but it shouldn’t stop there.

August 6, 2023

by Nicolas Fränkel

CORE

· 6,281 Views · 2 Likes

Infrastructure as Code: Exploring Terraform's Dominance

Explore core principles and benefits of IaC in terms of agility, scalability, and repeatability, as well as its significance in cloud computing and DevOps.

August 4, 2023

by Jagdish Mohite

· 9,728 Views · 5 Likes

Using Spring Cloud Gateway and Discovery Service for Seamless Request Routing

In this tutorial, learn how to route requests between Java microservices with Spring Cloud Gateway and Discovery Service.

August 4, 2023

by Denis Magda

CORE

· 15,226 Views · 7 Likes

Simplify Log Aggregation in AWS: A Comprehensive Guide to the Log Aggregation Pattern

Learn how to centralize log data from multiple sources, streamline monitoring, troubleshoot systems effectively, and enhance your log management strategy.

August 4, 2023

by Satrajit Basu

CORE

· 8,023 Views · 3 Likes

Karpenter – Simplify Autoscaling for Amazon EKS

Explore Karpenter’s role in simplifying autoscaling for Amazon EKS, providing intelligent instance selection, native Spot instance support, and cluster management.

August 4, 2023

by Ankush Madaan

· 6,228 Views · 1 Like

Battling Database Performance

Earlier this year, we experienced intermittent timeouts in our application — here’s how we tried to address the underlying issue over the next two weeks.

August 4, 2023

by Rory Bain

· 4,523 Views · 1 Like

How to Design an AI-Based Enterprise Search in AWS

Step-by-step guide in designing an intelligent Enterprise Search capability using natural language processing and advanced machine learning in AWS.

August 4, 2023

by Suvoraj Biswas

· 9,496 Views · 2 Likes

Cloud Security in Hybrid and Multi-Cloud

Cloud Security Challenges in a Hybrid and Multi-Cloud Environment. Complexities involved with it and strategies for mitigation.

August 4, 2023

by Manish Mradul

· 6,245 Views · 3 Likes

Using A/B Testing To Make Data-Driven Product Decisions

In this brief guide to AB testing, we'll explore the basics of this powerful technique and how it can drive better results and outcomes for your business.

August 3, 2023

by Shashank Agarwal

· 3,457 Views · 1 Like

How Is AI Revolutionizing the World of Internet of Things?

Advanced IoT with AI solutions is reshaping our world, permeating every area of our lives. The fusion of AI and IoT is driving unprecedented innovation and progress.

August 3, 2023

by Boshra Ubin

· 3,788 Views · 1 Like

DevSecOps: Enhancing Security With Vulnerability Scanning of Images and Source Code in CI/CD

This guide shows how to use Syft, Grype, and Trivy to scan container images for vulnerabilities in Gitlab pipelines during release.

August 3, 2023

by Vasilii Kulazhenkov

· 3,667 Views · 2 Likes

Penetration Testing: A Comprehensive Guide

Penetration testing is a security testing technique that incorporates launching unauthorized attacks to gain access to sensitive data.

August 3, 2023

by Chella Palaniappan

· 4,466 Views · 2 Likes

Visualizing a Career Path

Explaining a career path to someone who doesn't have the same background (as can happen in larger orgs) is hard. Discover a helpful approach for this issue here.

August 2, 2023

by Phil Wilkins

· 6,125 Views · 4 Likes

6 Effective Strategies for Kubernetes Observability in Hybrid Cloud Environments

Observing Kubernetes in hybrid cloud environments requires understanding distributed system behavior and performance. These six strategies can help achieve this.

August 2, 2023

by Sam Suthar

· 9,821 Views · 5 Likes

Data Integration

Data integration empowers businesses to unify customer data, personalize experiences, optimize operations, and drive success in competitive industries.

August 2, 2023

by Andrea Arnold

· 4,784 Views · 1 Like

4 Email Validation and Verification Techniques for App Developers

Email is still a key communication channel. Here are four ways for developers to add email verification and validation functions to their apps.

August 2, 2023

by Philip Piletic

CORE

· 4,125 Views · 2 Likes

The Latest Data Engineering Topics