Data Engineering Resources

Automating AWS Infrastructure Testing With Terratest

Terratest validates Terraform-based AWS resources, running checks and tearing them down afterward to catch issues early and prevent production misconfigurations.

January 8, 2025

by Sai Sandeep Ogety

CORE

· 6,609 Views · 15 Likes

Efficient Artificial Intelligence: Training to Production

With the advancements in artificial intelligence, the models are getting increasingly complex, resulting in increased size and latency.

January 8, 2025

by Surabhi Sinha

· 2,963 Views · 3 Likes

When (Tech Service) Relationships Don’t Work Out

When an existing implementation no longer aligns with business objectives, existing cloud resources can be exposed via the concept of VPC Peering.

January 8, 2025

by John Vester

CORE

· 47,522 Views · 3 Likes

Understanding WebRTC Security Architecture and IoT

Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.

January 8, 2025

by Carsten Rhod Gregersen

· 6,988 Views · 1 Like

Best Practices for Designing Resilient APIs for Scalability and Reliability

API resiliency demands continuous learning, scalability, and adaptation to new tools, ensuring robust, future-proof systems for evolving digital needs.

January 8, 2025

by Parvin Gasimzade

· 9,188 Views · 3 Likes

Securely Sign and Manage Documents Digitally With DocuSign and Ballerina

Integrate DocuSign with Ballerina, enabling straightforward interaction with DocuSign APIs to send envelopes, manage recipients, and track statuses.

January 8, 2025

by Nuvindu Hewapathirana

· 5,846 Views · 3 Likes

I Built an Automatic Proposal Generation LLM and Open-Sourced It on GitHub

Existing large models couldn’t solve my problem, so I built my own — an open-source tool for automating proposal generation efficiently.

January 7, 2025

by William Guo

· 6,336 Views

Pathway to Legacy Application Retirement

This article looks at application retirement from a data perspective, best practices, challenges, and how to manage and leverage data during this process.

January 7, 2025

by Abhik Choudhury

· 3,744 Views · 2 Likes

Usage of GenAI for Personalized Customer Experience in Mobile Apps

Generative AI enhances mobile apps with personalized, engaging user experiences, delighting users through smart data use and continuous improvement.

January 7, 2025

by Yogesh Rathod

· 2,792 Views · 2 Likes

A Deep Dive on Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 7, 2025

by Ganapathy Subramanian Ramachandran

· 7,349 Views · 3 Likes

Automating Twilio Recording Exports for Quality Purposes: Python Implementation Guidelines

Discover how to use Python to download recordings from Twilio and transcribe them for sentimental analysis, quality, and audit purposes.

January 7, 2025

by Sandeep Kakani

· 4,291 Views · 2 Likes

Applying ML and AI for Effective Spamhaus Email Etiquette

Explore how ML/AI can be leveraged for Spamhaus email etiquette and security, highlighting techniques used for spam detection, and upholding responsible email standards.

January 7, 2025

by John Akkarakaran Jose

· 10,295 Views · 1 Like

Data Governance Challenges in the Age of Generative AI

Navigate privacy, security, and compliance challenges for innovation. Effective data governance is now more critical due to recent generative AI developments.

January 7, 2025

by nishchai jayanna manjula

· 6,945 Views · 3 Likes

Testing Is a Cross-Cutting Concern; So Are Databases

It’s essential to test all database changes cohesively throughout the pipeline. Let’s explore how this can be achieved with a modern approach.

January 7, 2025

by Adam Furmanek

CORE

· 4,194 Views · 3 Likes

How to Test DELETE Requests for API Testing With Playwright Java

This tutorial demonstrates how to test DELETE requests using the Playwright Java framework for API testing, using examples of deleting data using an API.

January 7, 2025

by Faisal Khatri

CORE

· 6,237 Views · 2 Likes

The Evolution of Adaptive Frameworks

Adaptive frameworks revolutionize collaboration by providing real-time, personalized updates that address traditional tool limitations.

January 6, 2025

by Manasi Sharma

· 3,862 Views · 2 Likes

Achieving Security and Trust in a Data Fabric: The Role of Zero Trust Architecture

Explore how zero-trust architecture (ZTA) can provide a solid foundation for achieving security and trust in a data fabric.

January 6, 2025

by Julian Durand

· 5,335 Views · 3 Likes

Efficiently Processing Billions of Rows Daily With Presto

In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.

January 6, 2025

by Ajay Krishnan Prabhakaran

· 5,445 Views · 3 Likes

Why Successful Companies Don't Have DBAs

Consider the possibility that DBAs' current role may be problematic and that we need to rethink how they operate and integrate within our organizations.

January 6, 2025

by Adam Furmanek

CORE

· 4,569 Views · 7 Likes

Setting Up Local Kafka Container for Spring Boot Application

Set up Kafka container for Spring Boot application, which covers container configuration, Docker Desktop, and Spring Boot integration.

January 6, 2025

by Amol Gote

CORE

· 6,524 Views · 4 Likes

The Latest Data Engineering Topics