Data Engineering Resources

Offline Data Pipeline Best Practices Part 1:Optimizing Airflow Job Parameters for Apache Hive

Optimize offline data pipeline with Apache Airflow and AWS EMR. Focus on cost-effective strategies and Hive job configurations to reduce computing costs.

December 27, 2023

by Mitesh Mangaonkar

· 6,307 Views · 3 Likes

Embracing GraphQL: A Paradigm Shift in API Development

Have you heard about GraphQL? Let's explore this article to understand why we should embrace GraphQL, a new API paradigm!

December 27, 2023

by Yilia Lin

· 4,027 Views · 1 Like

PostgresML: Extension That Turns PostgreSQL Into a Platform for AI Apps

Learn how to use the PostgresML extension for text translation, sentiment analysis, and other AI-related tasks within PostgreSQL.

December 27, 2023

by Denis Magda

CORE

· 6,902 Views · 3 Likes

Microservices Resilient Testing Framework

This article explores the key principles that form the foundation for MRTF and how it fits into a cohesive framework for testing microservices.

December 27, 2023

by Stelios Manioudakis

CORE

· 21,122 Views · 5 Likes

AWS CDK Deep Dive: Advanced Infrastructure as Code Techniques With TypeScript and Python

This article will dive deeply into advanced techniques for using the CDK with TypeScript and Python, two of the most popular languages.

December 26, 2023

by Raghava Dittakavi

CORE

· 7,749 Views · 5 Likes

Contact Center Feature Flags Using AWS AppConfig

This article covers the step-by-step process of releasing new requirements using Feature Flags in AWS AppConfig.

December 25, 2023

by Srinivas Akella

· 6,021 Views · 3 Likes

Improving API Error Responses With the Result Pattern

Discover how the Result pattern enhances API error handling. Learn practical tips for improving your APIs reliability, scalability, and more.

December 25, 2023

by Jasen Palmer

· 6,732 Views · 7 Likes

PostgreSQL as a Vector Database: Getting Started and Scaling

In this article, learn how to build and scale a sample Airbnb recommendation service using PostgreSQL as a vector database.

December 25, 2023

by Denis Magda

CORE

· 14,765 Views · 9 Likes

Five Apache Projects You Probably Didn’t Know About

Learn more about Five Apache projects and some basic information about these five Apache projects.

December 25, 2023

by Nicolas Fränkel

· 13,361 Views · 6 Likes

Optimization of I/O Workloads by Profiling in Python

Optimizing the Python code to run faster.

December 24, 2023

by Anandaganesh Balakrishnan

· 7,106 Views · 4 Likes

Navigating the Technological Landscape of FinTech

A Deep Dive into 2024 Trends for FinTech Technologists with Techtrust Co-Founder, BK Bhāte.

December 24, 2023

by BK Bhate

· 4,751 Views · 2 Likes

REST Clients With OpenFeign: How to Implement Them

In this article, readers will learn how to implement REST clients with the Spring Cloud OpenFeign module and how to configure them.

December 23, 2023

by Mario Casari

· 11,593 Views · 7 Likes

Best Practices: Maximizing AI Revenue Growth With Customer Success

Unlock AI revenue growth with strategic customer success. Learn best practices for maximizing profitability with API management in our insightful guide.

December 23, 2023

by Rachael Kiselev

· 4,502 Views · 2 Likes

Extending Q-Learning With Dyna-Q for Enhanced Decision-Making

Explore Dyna-Q, an advanced reinforcement learning algorithm that extends Q-Learning by combining real experiences with simulated planning.

December 22, 2023

by Ashok Gorantla

CORE

· 20,811 Views · 7 Likes

Cloud Computing Trends For 2024

Navigate the evolving 2024 cloud computing landscape with Generative AI Fabric, quantum computing Co-pilot, edge synergy, and sustainable technologies.

December 22, 2023

by Navveen Balani

· 7,887 Views · 7 Likes

Navigating the Tech Landscape: Reflections on 2023 and Predictions for 2024

From active archiving to green data centers and the rise of optical storage, gain insights into the intersection of technology, business, and the environment.

December 22, 2023

by Tom Smith

CORE

· 4,730 Views · 2 Likes

AI Is Transforming How We Use Software Diagrams

Discover how the power of AI can help developers automate the creation and maintenance of their visuals. Let’s take a deep dive into AI's effect on diagramming.

December 22, 2023

by Knut Sveidqvist

· 5,603 Views · 2 Likes

Azure Function Build Release Pipeline in Azure DevOps CI/CD

Learn how to take your simple Azure Functions application and automate build and release processes.

Updated December 22, 2023

by Sibeesh Venu

· 28,254 Views · 7 Likes

Running LLMs Locally: A Step-by-Step Guide

In this article, take a closer look at LocalAI, an open-source alternative to OpenAI that allows you to run LLMs on your local machine.

December 22, 2023

by Gunter Rotsaert

CORE

· 9,498 Views · 11 Likes

How To Create Your Own AI Bot Like ChatGPT and Monetize It

Create your own AI bot like ChatGPT. Learn customization and monetization and dive into AI innovation. Turn your coding skills into profit with our step-by-step guide!

December 22, 2023

by Ayush Tanwal

· 5,113 Views · 2 Likes

The Latest Data Engineering Topics