Data Engineering Resources

Automating Operational Efficiency: Integrating AI Insights From Amazon SageMaker Into Business Workflows

Integrating AI within AWS RDS MySQL for managing terabytes of flight data on a weekly basis involves leveraging AWS's vast ecosystem of AI and data services.

April 2, 2024

by Vijay Panwar

CORE

· 1,689 Views · 1 Like

Data Lake vs. Data Warehouse

Data lakes offer flexibility with raw data; data warehouses provide structured data for quick insights. Each has its own benefits and trade-offs.

April 2, 2024

by Pier-Jean MALANDRINO

CORE

· 1,635 Views · 4 Likes

Node-RED Unleashed: Transforming Industrial IoT Development and Industry Collaboration With Hitachi

Hear from Hitachi's Kazuhito Yokoi to find out more about Node-RED and why it is becoming so popular in Industrial IoT applications.

April 2, 2024

by Jesse Casman

CORE

· 11,591 Views · 8 Likes

Demystifying Event Storming: Design Level, Identifying Bounded Contexts (Part 4)

Learn how event storming aids in identifying and defining bounded contexts, explore insights on different types, and discuss Conway's Law and external systems' influence.

April 2, 2024

by Alireza Rahmani Khalili

CORE

· 4,911 Views · 3 Likes

DSL Validations: Operators

Now that we have seen how the DSL validates individual properties, the next step is to combine individual property validations into larger, more complex conditionals.

April 2, 2024

by Scott Sosna

CORE

· 1,825 Views · 1 Like

OpenAI Evals Using Phoenix

OpenAI Evals are used for evaluating LLM models and finding accuracy, which helps to compare the custom models and figure out how best your custom model performs.

April 2, 2024

by Somanath Balakrishnan

CORE

· 2,206 Views · 1 Like

Understanding Prompt Injection and Other Risks of Generative AI

By prioritizing security, organizations can enhance trust, resilience, and reliability in their cloud and AI environments.

April 2, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 10,801 Views · 5 Likes

The Evolution of Conversational AI: From Chatbots to Coherent Conversations With GenAI and LLMs

Conversational AI has evolved, transitioning from simplistic rule- or FAQ-based systems to advanced virtual assistants capable of human-like dialogue.

April 2, 2024

by Pratik Prakash

CORE

· 6,691 Views · 3 Likes

Snowflake Micro-Partitioning: Technical Insights, Examples, and Advanced Developer Guide

Snowflake micro-partitioning boosts query performance, scalability, and storage efficiency with advanced developer tactics.

April 2, 2024

by Arun Pandey

CORE

· 13,005 Views · 3 Likes

Navigating the Data Landscape: A Guide for Developers, Engineers, and Architects

Understand the roles of data analysts, engineers, and scientists. Learn how they collaborate and what to consider for a career in data insights for devs and IT pros.

April 2, 2024

by Tom Smith

CORE

· 2,215 Views · 2 Likes

DevSecOps: It’s Time To Pay for Your Demand, Not Ingestion

Asking engineers to cut back on logging introduces an unnecessary distraction from a supportability and toil perspective – impacting primary objectives along the way.

April 2, 2024

by John Vester

CORE

· 52,920 Views · 3 Likes

Introduction to Generative AI: Empowering Enterprises Through Disruptive Innovation

Leveraging deep learning models, generative AI exhibits a unique ability to interpret diverse input types and seamlessly generate novel content across various modalities.

April 1, 2024

by Tuhin Chattopadhyay

CORE

· 16,460 Views · 3 Likes

Achieving Data Excellence: How Generative AI Revolutionizes Data Integration

Data and generative AI services that provide data analysis, ETL, and NLP enable robust integration strategies for unlocking the full potential of data assets.

March 31, 2024

by Boris Zaikin

CORE

· 4,741 Views · 4 Likes

MLOps Architectural Models: An Advanced Guide to MLOps in Practice

Learn about MLOps architectural challenges and ways to manage complexity through this end-to-end guide for MLOps app development with a financial institution use case.

March 30, 2024

by Daniela Kolarova

CORE

· 4,763 Views · 3 Likes

How To Implement OAuth2 Security in Microservices

Learn to implement OAuth2 Security in microservices distributed systems using OAuth2, Oauth2-Client, Spring Cloud, and Netflix components with full examples.

Updated March 29, 2024

by Md Amran Hossain

CORE

· 103,369 Views · 17 Likes

How To Run OWASP ZAP Security Tests in Azure DevOps Pipeline

In this article, learn how configuring OWASP ZAP security tests for webpage UI or API helps to identify the security risks.

Updated March 29, 2024

by Ganesh Hegde

· 46,459 Views · 2 Likes

Secure and Scalable CI/CD Pipeline With AWS

Amazon and DevOps go hand-in-hand with a number of tools and processes that enable an efficient CI/CD pipeline.

Updated March 29, 2024

by Chandani Patel Bhagat

· 42,585 Views · 11 Likes

Exploring the Different Types of Cloud Computing Models

In this article, we'll delve into the different types of cloud computing models, encompassing both service and deployment models, and their characteristics.

March 29, 2024

by Aditya Bhuyan

· 2,994 Views · 2 Likes

Building a Fortified Foundation: The Essential Guide to Secure Landing Zones in the Cloud

Explore Secure Landing Zones (SLZ), a foundational architecture in the cloud that provides a secure environment for hosting workloads.

March 29, 2024

by Josephine Eskaline Joyce, Ph.D

CORE

· 3,896 Views · 6 Likes

Cognitive and Perspective Analytics

Cognitive and perspective analytics represent powerful tools in the analytical era. When used together, they can provide a more complete picture of analytics data.

March 29, 2024

by Prashanth Mally

· 1,996 Views · 1 Like

The Latest Data Engineering Topics