Data Engineering Resources

Efficient Ticket Management Using LangChain and Large Language Models

LangChain agents, powered by ChatGPT, revolutionize JIRA ticket creation for seamless cross-team collaboration, boosting efficiency and productivity.

April 3, 2024

by Rupali Kaushik

· 8,708 Views · 5 Likes

Building Resilient Cybersecurity Into Supply Chain Operations: A Technical Approach

Adding cybersecurity measures into each facet of the supply chain safeguards operations and sensitive data, giving a competitive edge in the digital marketplace.

April 3, 2024

by Akanksha Pathak

CORE

· 4,079 Views · 3 Likes

Automating Operational Efficiency: Integrating AI Insights From Amazon SageMaker Into Business Workflows

Integrating AI within AWS RDS MySQL for managing terabytes of flight data on a weekly basis involves leveraging AWS's vast ecosystem of AI and data services.

April 2, 2024

by Vijay Panwar

CORE

· 1,602 Views · 1 Like

Data Lake vs. Data Warehouse

Data lakes offer flexibility with raw data; data warehouses provide structured data for quick insights. Each has its own benefits and trade-offs.

April 2, 2024

by Pier-Jean MALANDRINO

CORE

· 1,565 Views · 3 Likes

Node-RED Unleashed: Transforming Industrial IoT Development and Industry Collaboration With Hitachi

Hear from Hitachi's Kazuhito Yokoi to find out more about Node-RED and why it is becoming so popular in Industrial IoT applications.

April 2, 2024

by Jesse Casman

CORE

· 10,359 Views · 7 Likes

Demystifying Event Storming: Design Level, Identifying Bounded Contexts (Part 4)

Learn how event storming aids in identifying and defining bounded contexts, explore insights on different types, and discuss Conway's Law and external systems' influence.

April 2, 2024

by Alireza Rahmani Khalili

CORE

· 4,729 Views · 3 Likes

DSL Validations: Operators

Now that we have seen how the DSL validates individual properties, the next step is to combine individual property validations into larger, more complex conditionals.

April 2, 2024

by Scott Sosna

CORE

· 1,734 Views · 1 Like

OpenAI Evals Using Phoenix

OpenAI Evals are used for evaluating LLM models and finding accuracy, which helps to compare the custom models and figure out how best your custom model performs.

April 2, 2024

by Somanath Balakrishnan

CORE

· 2,061 Views · 1 Like

Understanding Prompt Injection and Other Risks of Generative AI

By prioritizing security, organizations can enhance trust, resilience, and reliability in their cloud and AI environments.

April 2, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 10,042 Views · 5 Likes

The Evolution of Conversational AI: From Chatbots to Coherent Conversations With GenAI and LLMs

Conversational AI has evolved, transitioning from simplistic rule- or FAQ-based systems to advanced virtual assistants capable of human-like dialogue.

April 2, 2024

by Pratik Prakash

CORE

· 6,507 Views · 3 Likes

Snowflake Micro-Partitioning: Technical Insights, Examples, and Advanced Developer Guide

Snowflake micro-partitioning boosts query performance, scalability, and storage efficiency with advanced developer tactics.

April 2, 2024

by Arun Pandey

CORE

· 12,278 Views · 2 Likes

Navigating the Data Landscape: A Guide for Developers, Engineers, and Architects

Understand the roles of data analysts, engineers, and scientists. Learn how they collaborate and what to consider for a career in data insights for devs and IT pros.

April 2, 2024

by Tom Smith

CORE

· 2,124 Views · 1 Like

DevSecOps: It’s Time To Pay for Your Demand, Not Ingestion

Asking engineers to cut back on logging introduces an unnecessary distraction from a supportability and toil perspective – impacting primary objectives along the way.

April 2, 2024

by John Vester

CORE

· 52,803 Views · 3 Likes

Introduction to Generative AI: Empowering Enterprises Through Disruptive Innovation

Leveraging deep learning models, generative AI exhibits a unique ability to interpret diverse input types and seamlessly generate novel content across various modalities.

April 1, 2024

by Tuhin Chattopadhyay

CORE

· 15,558 Views · 2 Likes

Achieving Data Excellence: How Generative AI Revolutionizes Data Integration

Data and generative AI services that provide data analysis, ETL, and NLP enable robust integration strategies for unlocking the full potential of data assets.

March 31, 2024

by Boris Zaikin

CORE

· 4,595 Views · 4 Likes

MLOps Architectural Models: An Advanced Guide to MLOps in Practice

Learn about MLOps architectural challenges and ways to manage complexity through this end-to-end guide for MLOps app development with a financial institution use case.

March 30, 2024

by Daniela Kolarova

CORE

· 4,615 Views · 3 Likes

How To Implement OAuth2 Security in Microservices

Learn to implement OAuth2 Security in microservices distributed systems using OAuth2, Oauth2-Client, Spring Cloud, and Netflix components with full examples.

Updated March 29, 2024

by Md Amran Hossain

CORE

· 102,460 Views · 17 Likes

How To Run OWASP ZAP Security Tests in Azure DevOps Pipeline

In this article, learn how configuring OWASP ZAP security tests for webpage UI or API helps to identify the security risks.

Updated March 29, 2024

by Ganesh Hegde

· 46,084 Views · 2 Likes

Secure and Scalable CI/CD Pipeline With AWS

Amazon and DevOps go hand-in-hand with a number of tools and processes that enable an efficient CI/CD pipeline.

Updated March 29, 2024

by Chandani Patel Bhagat

· 42,321 Views · 11 Likes

Exploring the Different Types of Cloud Computing Models

In this article, we'll delve into the different types of cloud computing models, encompassing both service and deployment models, and their characteristics.

March 29, 2024

by Aditya Bhuyan

· 2,420 Views · 2 Likes

The Latest Data Engineering Topics