Data Engineering Resources

AWS Cloud Security: Key Components, Common Vulnerabilities, and Best Practices

Organizations can achieve a robust security posture in AWS by understanding key AWS security components, mitigating vulnerabilities, and adhering to best practices.

January 8, 2025

by John Akkarakaran Jose

· 5,487 Views · 2 Likes

Automating AWS Infrastructure Testing With Terratest

Terratest validates Terraform-based AWS resources, running checks and tearing them down afterward to catch issues early and prevent production misconfigurations.

January 8, 2025

by Sai Sandeep Ogety

CORE

· 4,594 Views · 15 Likes

Efficient Artificial Intelligence: Training to Production

With the advancements in artificial intelligence, the models are getting increasingly complex, resulting in increased size and latency.

January 8, 2025

by Surabhi Sinha

· 2,358 Views · 2 Likes

When (Tech Service) Relationships Don’t Work Out

When an existing implementation no longer aligns with business objectives, existing cloud resources can be exposed via the concept of VPC Peering.

January 8, 2025

by John Vester

CORE

· 32,252 Views · 2 Likes

Understanding WebRTC Security Architecture and IoT

Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.

January 8, 2025

by Carsten Rhod Gregersen

· 4,027 Views

Best Practices for Designing Resilient APIs for Scalability and Reliability

API resiliency demands continuous learning, scalability, and adaptation to new tools, ensuring robust, future-proof systems for evolving digital needs.

January 8, 2025

by Parvin Gasimzade

· 4,581 Views

Securely Sign and Manage Documents Digitally With DocuSign and Ballerina

Integrate DocuSign with Ballerina, enabling straightforward interaction with DocuSign APIs to send envelopes, manage recipients, and track statuses.

January 8, 2025

by Nuvindu Hewapathirana

· 4,549 Views · 3 Likes

I Built an Automatic Proposal Generation LLM and Open-Sourced It on GitHub

Existing large models couldn’t solve my problem, so I built my own — an open-source tool for automating proposal generation efficiently.

January 7, 2025

by William Guo

· 3,296 Views

Pathway to Legacy Application Retirement

This article looks at application retirement from a data perspective, best practices, challenges, and how to manage and leverage data during this process.

January 7, 2025

by Abhik Choudhury

· 2,936 Views · 2 Likes

Usage of GenAI for Personalized Customer Experience in Mobile Apps

Generative AI enhances mobile apps with personalized, engaging user experiences, delighting users through smart data use and continuous improvement.

January 7, 2025

by Yogesh Rathod

· 1,738 Views · 2 Likes

A Deep Dive on Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 7, 2025

by Ganapathy Subramanian Ramachandran

· 4,546 Views · 3 Likes

Automating Twilio Recording Exports for Quality Purposes: Python Implementation Guidelines

Discover how to use Python to download recordings from Twilio and transcribe them for sentimental analysis, quality, and audit purposes.

January 7, 2025

by Sandeep Kakani

· 2,934 Views · 2 Likes

Applying ML and AI for Effective Spamhaus Email Etiquette

Explore how ML/AI can be leveraged for Spamhaus email etiquette and security, highlighting techniques used for spam detection, and upholding responsible email standards.

January 7, 2025

by John Akkarakaran Jose

· 2,694 Views · 1 Like

Data Governance Challenges in the Age of Generative AI

Navigate privacy, security, and compliance challenges for innovation. Effective data governance is now more critical due to recent generative AI developments.

January 7, 2025

by nishchai jayanna manjula

· 5,315 Views · 3 Likes

Testing Is a Cross-Cutting Concern; So Are Databases

It’s essential to test all database changes cohesively throughout the pipeline. Let’s explore how this can be achieved with a modern approach.

January 7, 2025

by Adam Furmanek

CORE

· 3,538 Views · 2 Likes

How to Test DELETE Requests for API Testing With Playwright Java

This tutorial demonstrates how to test DELETE requests using the Playwright Java framework for API testing, using examples of deleting data using an API.

January 7, 2025

by Faisal Khatri

CORE

· 4,711 Views

The Evolution of Adaptive Frameworks

Adaptive frameworks revolutionize collaboration by providing real-time, personalized updates that address traditional tool limitations.

January 6, 2025

by Manasi Sharma

· 2,494 Views · 1 Like

Achieving Security and Trust in a Data Fabric: The Role of Zero Trust Architecture

Explore how zero-trust architecture (ZTA) can provide a solid foundation for achieving security and trust in a data fabric.

January 6, 2025

by Julian Durand

· 3,744 Views · 2 Likes

Efficiently Processing Billions of Rows Daily With Presto

In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.

January 6, 2025

by Ajay Krishnan Prabhakaran

· 3,398 Views · 2 Likes

Why Successful Companies Don't Have DBAs

Consider the possibility that DBAs' current role may be problematic and that we need to rethink how they operate and integrate within our organizations.

January 6, 2025

by Adam Furmanek

CORE

· 3,738 Views · 6 Likes

The Latest Data Engineering Topics