Data Engineering Resources

Data Persistence: Keeping Data Safe in an Ever-Changing Digital World

Just as there is more data, there are more types of persistent data that must be secured for the future value it may be able to provide.

August 7, 2023

by Tom Smith

CORE

· 2,476 Views · 1 Like

Connect to AWS Athena Database in a Mule Application With Generic Database

This blog helps understand the steps to configure the Mule application to use generic database configuration to connect to Amazon Athena using the AWS Athena JDBC Driver.

August 7, 2023

by Anupam Chakraborty

· 2,794 Views · 2 Likes

Ensuring Reliable Microservice Deployment With Spring Boot Build Info Maven Plugin

Discover how to verify microservice deployments with the Spring Boot Build Info Maven Plugin, increasing the dependability of your deployment pipeline.

August 7, 2023

by Amol Gote

CORE

· 5,610 Views · 8 Likes

Building a Real-Time Alerting Solution With Zero Code

How cloud services can be leveraged to easily build a solution that allows you to define custom rules to trigger a notification.

August 7, 2023

by Siddarth Ramadoss

· 6,414 Views · 5 Likes

Variations With Stable Diffusion Depth2Img: A Step-By-Step Guide

A beginner's guide to preserving shape and depth in AI-Generated art, using Stable Diffusion Depth2Img and Node.js

August 7, 2023

by mike labs

· 1,881 Views · 1 Like

Game Day: Stress-Testing Our Response Systems and Processes

By running Game Days, we can meaningfully improve the way we respond to more significant, more complex incidents.

August 7, 2023

by Rory Bain

· 2,109 Views · 1 Like

Simplified Development With Azure DevOps

Azure DevOps streamlines software development by enabling cloud-based collaboration, automation, and real-time cooperation to increase efficiency and foster innovation.

August 7, 2023

by Samir Hazra

· 5,400 Views · 1 Like

System Architecture: Move Authentication to the API Gateway

When exposing an application to the outside world, consider a Reverse-Proxy or an API Gateway to protect it from attacks. Rate limiting comes to mind first, but it shouldn’t stop there.

August 6, 2023

by Nicolas Fränkel

· 6,884 Views · 2 Likes

Infrastructure as Code: Exploring Terraform's Dominance

Explore core principles and benefits of IaC in terms of agility, scalability, and repeatability, as well as its significance in cloud computing and DevOps.

August 4, 2023

by Jagdish Mohite

· 11,393 Views · 5 Likes

Using Spring Cloud Gateway and Discovery Service for Seamless Request Routing

In this tutorial, learn how to route requests between Java microservices with Spring Cloud Gateway and Discovery Service.

August 4, 2023

by Denis Magda

CORE

· 20,185 Views · 7 Likes

Simplify Log Aggregation in AWS: A Comprehensive Guide to the Log Aggregation Pattern

Learn how to centralize log data from multiple sources, streamline monitoring, troubleshoot systems effectively, and enhance your log management strategy.

August 4, 2023

by Satrajit Basu

CORE

· 9,257 Views · 3 Likes

Karpenter – Simplify Autoscaling for Amazon EKS

Explore Karpenter’s role in simplifying autoscaling for Amazon EKS, providing intelligent instance selection, native Spot instance support, and cluster management.

August 4, 2023

by Ankush Madaan

· 6,872 Views · 1 Like

Battling Database Performance

Earlier this year, we experienced intermittent timeouts in our application — here’s how we tried to address the underlying issue over the next two weeks.

August 4, 2023

by Rory Bain

· 4,836 Views · 1 Like

How to Design an AI-Based Enterprise Search in AWS

Step-by-step guide in designing an intelligent Enterprise Search capability using natural language processing and advanced machine learning in AWS.

August 4, 2023

by Suvoraj Biswas

· 10,376 Views · 2 Likes

Cloud Security in Hybrid and Multi-Cloud

Cloud Security Challenges in a Hybrid and Multi-Cloud Environment. Complexities involved with it and strategies for mitigation.

August 4, 2023

by Manish Mradul

· 7,479 Views · 3 Likes

Using A/B Testing To Make Data-Driven Product Decisions

In this brief guide to AB testing, we'll explore the basics of this powerful technique and how it can drive better results and outcomes for your business.

August 3, 2023

by Shashank Agarwal

· 4,442 Views · 1 Like

How Is AI Revolutionizing the World of Internet of Things?

Advanced IoT with AI solutions is reshaping our world, permeating every area of our lives. The fusion of AI and IoT is driving unprecedented innovation and progress.

August 3, 2023

by Boshra Ubin

· 4,568 Views · 1 Like

DevSecOps: Enhancing Security With Vulnerability Scanning of Images and Source Code in CI/CD

This guide shows how to use Syft, Grype, and Trivy to scan container images for vulnerabilities in Gitlab pipelines during release.

August 3, 2023

by Vasilii Kulazhenkov

· 4,609 Views · 2 Likes

Penetration Testing: A Comprehensive Guide

Penetration testing is a security testing technique that incorporates launching unauthorized attacks to gain access to sensitive data.

August 3, 2023

by Chella Palaniappan

· 5,700 Views · 2 Likes

Visualizing a Career Path

Explaining a career path to someone who doesn't have the same background (as can happen in larger orgs) is hard. Discover a helpful approach for this issue here.

August 2, 2023

by Phil Wilkins

· 7,304 Views · 5 Likes

The Latest Data Engineering Topics