Data Engineering Resources

Function Calling and Agents in Agentic AI

Function calling in agentic AI allows autonomous agents to dynamically execute tasks by invoking specific functions based on reasoning and goals.

April 1, 2025

by Bhala Ranganathan

CORE

· 1,513 Views

Understanding Database Consistency: A Key Concept in Distributed Systems

This article explores database consistency models in distributed systems and explains trade-offs between strong, eventual, causal, and other consistency types.

March 31, 2025

by Sandeep Kumar Gond

· 4,688 Views · 5 Likes

Doris vs Elasticsearch: A Comparison and Practical Cost Case Study

Apache Doris excels in analytics, SQL support, and cost efficiency, while Elasticsearch leads in text search but has higher storage costs and complexity.

March 31, 2025

by Darren Xu

· 2,581 Views · 1 Like

Stop Exposing Secrets! Secure Your APIs in Postman Like a Pro

Don't expose your secrets! Learn how to secure your APIs in Postman with Vault, Secret Scanner, and best practices to keep your data safe.

March 31, 2025

by Gbadebo Bello

· 3,858 Views · 6 Likes

Supervised and Unsupervised Learning in Machine Learning

Discover the pros and cons, types, applications, and lots more about two common machine learning algorithms: supervised learning and unsupervised learning.

March 31, 2025

by Jennifer Wales

· 1,794 Views · 2 Likes

AWS WAF Classic vs WAFV2: Features and Migration Considerations

AWS WAFV2 is a major upgrade over WAF Classic, offering better scalability, flexibility, and automation. We'll also look at key migration considerations.

March 31, 2025

by Srinivas Chippagiri

CORE

· 4,451 Views · 2 Likes

How Does Video Annotation Augment Computer Vision?

Video annotation is the way in which machines are actually getting the ability to process visual data; this is what closes the gap between AI and real-world applications.

March 31, 2025

by Rayan Potter

· 1,391 Views · 1 Like

Product Design vs Platform Design for Software Development

Compare platform and product design approaches for business needs. Understand their differences and compare them to find the best fit for your use case.

March 31, 2025

by Ravi Kiran Mallidi

CORE

· 3,185 Views · 4 Likes

The Role of DevSecOps in Securing Multi-Cloud Architectures

Discover how DevSecOps enhances security in multi-cloud ecosystems, enabling safe implementation and addressing key challenges with effective strategies.

March 31, 2025

by Hrushikesh Deshmukh

· 3,561 Views · 2 Likes

Getting Started With LangChain for Beginners

This tutorial demonstrates how to use the LangChain framework to connect with OpenAI and other LLMs, work with various chains, and build a basic chatbot with history.

March 28, 2025

by Amit Chaudhary

· 2,965 Views · 3 Likes

Challenges of Using LLMs in Production: Constraints, Hallucinations, and Guardrails

By integrating post-processing validation, RAG, and customizable guardrails, developers can bridge the gap between prototyping and production in LLM applications.

March 28, 2025

by Shiva Pati

· 2,484 Views · 1 Like

Why Mocking Sucks

Mocking can be risky as it doesn't replicate real-world conditions, making real development versions of services preferable.

March 28, 2025

by Andy Pai

· 3,242 Views · 2 Likes

Using Terraform Moved Block to Refactor Resources

Terraform moved block, introduced in version 1.1.0, provides a straightforward way to refactor resources by explicitly mapping old resource addresses to new ones.

March 28, 2025

by Mariusz Michalowski

· 3,306 Views · 1 Like

Building a Scalable ML Pipeline and API in AWS

This blog explains the architecture and design for building a scalable end-to-end ML pipeline using AWS for automated model execution, real-time data processing, and API.

March 28, 2025

by Dhanush Thirugnana

· 3,990 Views · 3 Likes

Accurate Quantitative Analysis With ChatGPT and Azure AI Hub

I asked ChatGPT the question, ‘9.9 or 9.11, which is bigger?’ ChatGPT alone answered incorrectly, but with the help of Python, it provided the correct answer: 9.9.

March 27, 2025

by Sanjeev Kumar

· 2,675 Views · 1 Like

Moving PeopleSoft ERP Data Between Databases With Data Mover Scripts

Learn how to efficiently move application data between different PeopleSoft databases using Data Mover scripts, with detailed examples and step-by-step instructions.

March 27, 2025

by Tirumala Rao Chimpiri

· 2,734 Views · 1 Like

Self-Healing Data Pipelines: The Next Big Thing in Data Engineering?

Build self-healing data pipelines on GCP using AI-powered tools like GPT-4 and Python to detect and fix errors automatically.

March 27, 2025

by Naresh Erukulla

· 7,090 Views

XAI: Making ML Models Transparent for Smarter Hiring Decisions

Explainable AI (XAI) lifts the veil on machine learning in recruiting, showing why candidates get scored or rejected — like skills mismatches or low experience.

March 27, 2025

by Pankaj Khurana

· 14,459 Views · 1 Like

Automatic Versioning in Mobile Apps

TL;DR: This article presents an automatic versioning and migration framework for mobile app databases using schema hashes and seamless upgrades.

March 27, 2025

by Liewen Huang, Ph.D.

· 2,227 Views · 2 Likes

Creating an Application With a Personality

Learn how to create an AI assistant with LangChain4j in a Spring Boot application, which personalizes the application itself and has access to its actuators.

March 27, 2025

by Tamas Kiss

· 3,240 Views · 1 Like

The Latest Data Engineering Topics