Data Engineering Resources

Scholcast: Generating Academic Paper Summaries With AI-Driven Audio

Scholcast is a Python package that converts academic papers into detailed summaries in A/V format using AI, making it easier to stay updated with the research.

January 8, 2025

by Sabarna Choudhuri

· 3,183 Views · 1 Like

Visualizing the Air Quality Index (AQI) Across Punjab, Pakistan, and India

Learn how to use IQAir data for visualizing air quality in Punjab to gain insight into the widespread impact of air pollution across the region.

January 8, 2025

by Akmal Chaudhri

CORE

· 3,209 Views

Top 5 Key Features of Apache Iceberg for Modern Data Lakes

Gain insight into key Iceberg features such as time travel, schema evolution, partition evolution, and ACID transactions with clear SQL examples and diagrams.

January 8, 2025

by Rajanikantarao Vellaturi

· 3,297 Views · 2 Likes

API and Security: From IT to Cyber

Learn how to protect your APIs beyond the basics. This article explores the risks, but also the solutions, which are not necessarily limited to the API Manager.

January 8, 2025

by Thomas Jardinet

CORE

· 4,918 Views · 2 Likes

AWS Cloud Security: Key Components, Common Vulnerabilities, and Best Practices

Organizations can achieve a robust security posture in AWS by understanding key AWS security components, mitigating vulnerabilities, and adhering to best practices.

January 8, 2025

by John Akkarakaran Jose

· 5,660 Views · 2 Likes

Automating AWS Infrastructure Testing With Terratest

Terratest validates Terraform-based AWS resources, running checks and tearing them down afterward to catch issues early and prevent production misconfigurations.

January 8, 2025

by Sai Sandeep Ogety

CORE

· 4,745 Views · 15 Likes

Efficient Artificial Intelligence: Training to Production

With the advancements in artificial intelligence, the models are getting increasingly complex, resulting in increased size and latency.

January 8, 2025

by Surabhi Sinha

· 2,451 Views · 2 Likes

When (Tech Service) Relationships Don’t Work Out

When an existing implementation no longer aligns with business objectives, existing cloud resources can be exposed via the concept of VPC Peering.

January 8, 2025

by John Vester

CORE

· 35,463 Views · 2 Likes

Understanding WebRTC Security Architecture and IoT

Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.

January 8, 2025

by Carsten Rhod Gregersen

· 4,971 Views

Best Practices for Designing Resilient APIs for Scalability and Reliability

API resiliency demands continuous learning, scalability, and adaptation to new tools, ensuring robust, future-proof systems for evolving digital needs.

January 8, 2025

by Parvin Gasimzade

· 5,144 Views · 1 Like

Securely Sign and Manage Documents Digitally With DocuSign and Ballerina

Integrate DocuSign with Ballerina, enabling straightforward interaction with DocuSign APIs to send envelopes, manage recipients, and track statuses.

January 8, 2025

by Nuvindu Hewapathirana

· 4,659 Views · 3 Likes

I Built an Automatic Proposal Generation LLM and Open-Sourced It on GitHub

Existing large models couldn’t solve my problem, so I built my own — an open-source tool for automating proposal generation efficiently.

January 7, 2025

by William Guo

· 3,558 Views

Pathway to Legacy Application Retirement

This article looks at application retirement from a data perspective, best practices, challenges, and how to manage and leverage data during this process.

January 7, 2025

by Abhik Choudhury

· 3,047 Views · 2 Likes

Usage of GenAI for Personalized Customer Experience in Mobile Apps

Generative AI enhances mobile apps with personalized, engaging user experiences, delighting users through smart data use and continuous improvement.

January 7, 2025

by Yogesh Rathod

· 1,817 Views · 2 Likes

A Deep Dive on Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 7, 2025

by Ganapathy Subramanian Ramachandran

· 5,015 Views · 3 Likes

Automating Twilio Recording Exports for Quality Purposes: Python Implementation Guidelines

Discover how to use Python to download recordings from Twilio and transcribe them for sentimental analysis, quality, and audit purposes.

January 7, 2025

by Sandeep Kakani

· 3,057 Views · 2 Likes

Applying ML and AI for Effective Spamhaus Email Etiquette

Explore how ML/AI can be leveraged for Spamhaus email etiquette and security, highlighting techniques used for spam detection, and upholding responsible email standards.

January 7, 2025

by John Akkarakaran Jose

· 9,528 Views · 1 Like

Data Governance Challenges in the Age of Generative AI

Navigate privacy, security, and compliance challenges for innovation. Effective data governance is now more critical due to recent generative AI developments.

January 7, 2025

by nishchai jayanna manjula

· 5,561 Views · 3 Likes

Testing Is a Cross-Cutting Concern; So Are Databases

It’s essential to test all database changes cohesively throughout the pipeline. Let’s explore how this can be achieved with a modern approach.

January 7, 2025

by Adam Furmanek

CORE

· 3,627 Views · 2 Likes

How to Test DELETE Requests for API Testing With Playwright Java

This tutorial demonstrates how to test DELETE requests using the Playwright Java framework for API testing, using examples of deleting data using an API.

January 7, 2025

by Faisal Khatri

CORE

· 5,387 Views

The Latest Data Engineering Topics