Data Engineering Resources

Optimizing SQL Server Performance With AI: Automating Query Optimization and Predictive Maintenance

AI enhances SQL Server performance through query optimization and predictive maintenance, boosts efficiency, reduces latency, and improves system scalability.

January 10, 2025

by Vijay Panwar

CORE

· 5,208 Views · 2 Likes

Top 5 Books to Enhance Your Software Design Skills in 2025

Discover the top 5 books to master software design, from simplicity to clean code, testing, and Java best practices — plus a bonus on design patterns.

January 10, 2025

by Otavio Santana

CORE

· 7,060 Views · 8 Likes

Maximizing AI Agents for Seamless DevOps and Cloud Success

Harness the power of AI agents in DevOps and cloud delivery for success. Explore how to use AI in DevOps and cloud environments in this article.

January 9, 2025

by Marija Naumovska

CORE

· 5,036 Views · 4 Likes

Quantum Machine Learning for Large-Scale Data-Intensive Applications

This article examines how QML can harness the principles of quantum mechanics to achieve significant computational advantages over classical approaches.

January 9, 2025

by Manasi Sharma

· 6,068 Views · 1 Like

A Hands-On Guide to Enable Amazon GuardDuty on AWS Account

This hands-on guide will help you enable Amazon GuardDuty via the AWS Console in order to monitor and detect security threats in your AWS environment.

January 9, 2025

by Sai Sandeep Ogety

CORE

· 3,902 Views · 13 Likes

Mastering Retrieval Augmented Generation: From Fundamentals to Advanced Techniques

RAG enhances LLMs by linking them to external retrieval systems, while advanced RAG addresses challenges in query formulation, embedding generation, and accuracy.

January 9, 2025

by Salman Khan

CORE

· 6,965 Views · 4 Likes

Formulating a Robust Strategy for Storage in Amazon Relational Database Service PostgreSQL Deployments

This article explores understanding the key components of RDS storage, optimizing these storage factors, and capping storage growth by utilizing retention periods.

January 9, 2025

by Vivek Singh

· 3,495 Views · 2 Likes

AI Governance: Building Ethical and Transparent Systems for the Future

This article takes a deep dive into AI governance, including insights surrounding its challenges, frameworks, standards, and more.

January 9, 2025

by Sukanya Konatam

· 6,726 Views · 2 Likes

Scholcast: Generating Academic Paper Summaries With AI-Driven Audio

Scholcast is a Python package that converts academic papers into detailed summaries in A/V format using AI, making it easier to stay updated with the research.

January 8, 2025

by Sabarna Choudhuri

· 3,183 Views · 1 Like

Visualizing the Air Quality Index (AQI) Across Punjab, Pakistan, and India

Learn how to use IQAir data for visualizing air quality in Punjab to gain insight into the widespread impact of air pollution across the region.

January 8, 2025

by Akmal Chaudhri

CORE

· 3,208 Views

Top 5 Key Features of Apache Iceberg for Modern Data Lakes

Gain insight into key Iceberg features such as time travel, schema evolution, partition evolution, and ACID transactions with clear SQL examples and diagrams.

January 8, 2025

by Rajanikantarao Vellaturi

· 3,269 Views · 2 Likes

API and Security: From IT to Cyber

Learn how to protect your APIs beyond the basics. This article explores the risks, but also the solutions, which are not necessarily limited to the API Manager.

January 8, 2025

by Thomas Jardinet

CORE

· 4,918 Views · 2 Likes

AWS Cloud Security: Key Components, Common Vulnerabilities, and Best Practices

Organizations can achieve a robust security posture in AWS by understanding key AWS security components, mitigating vulnerabilities, and adhering to best practices.

January 8, 2025

by John Akkarakaran Jose

· 5,654 Views · 2 Likes

Automating AWS Infrastructure Testing With Terratest

Terratest validates Terraform-based AWS resources, running checks and tearing them down afterward to catch issues early and prevent production misconfigurations.

January 8, 2025

by Sai Sandeep Ogety

CORE

· 4,742 Views · 15 Likes

Efficient Artificial Intelligence: Training to Production

With the advancements in artificial intelligence, the models are getting increasingly complex, resulting in increased size and latency.

January 8, 2025

by Surabhi Sinha

· 2,449 Views · 2 Likes

When (Tech Service) Relationships Don’t Work Out

When an existing implementation no longer aligns with business objectives, existing cloud resources can be exposed via the concept of VPC Peering.

January 8, 2025

by John Vester

CORE

· 35,462 Views · 2 Likes

Understanding WebRTC Security Architecture and IoT

Learn more about how WebRTC's triple-layer security architecture protects IoT communications and creates the building blocks of secure device interactions.

January 8, 2025

by Carsten Rhod Gregersen

· 4,953 Views

Best Practices for Designing Resilient APIs for Scalability and Reliability

API resiliency demands continuous learning, scalability, and adaptation to new tools, ensuring robust, future-proof systems for evolving digital needs.

January 8, 2025

by Parvin Gasimzade

· 5,119 Views · 1 Like

Securely Sign and Manage Documents Digitally With DocuSign and Ballerina

Integrate DocuSign with Ballerina, enabling straightforward interaction with DocuSign APIs to send envelopes, manage recipients, and track statuses.

January 8, 2025

by Nuvindu Hewapathirana

· 4,656 Views · 3 Likes

I Built an Automatic Proposal Generation LLM and Open-Sourced It on GitHub

Existing large models couldn’t solve my problem, so I built my own — an open-source tool for automating proposal generation efficiently.

January 7, 2025

by William Guo

· 3,548 Views

The Latest Data Engineering Topics