Data Engineering Resources

Cybersecurity in the Cloud: Integrating Continuous Security Testing Within DevSecOps

AI assisted cyberattacks against cloud infrastructure is a fast growing threat. Integrating CST within DevSecOps serves as a crucial weapon for organizations.

March 5, 2024

by Prithvish Kovelamudi

· 7,187 Views · 8 Likes

Unveiling the Clever Way: Converting XML to Relational Data

Discover the smart and efficient method for converting XML data into relational format with expert insights and strategies.

March 5, 2024

by Manas Sadangi

· 5,457 Views · 1 Like

Unpacking Our Findings From Assessing Numerous Infrastructures (Part 2)

Making superior performance accessible. Get better at assessing your core infrastructure needs, find out where engineering teams often falter.

March 5, 2024

by Komal J Prabhakar

· 4,493 Views · 2 Likes

Secure Your API With These 16 Practices With Apache APISIX (Part 2)

Last week, we listed 16 practices to help secure one's APIs and described how to implement them with Apache APISIX. This week, we will look at the remaining practices.

March 4, 2024

by Nicolas Fränkel

· 2,562 Views · 1 Like

Build a Real-Time Materialized View From Postgres Changes

Learn how to stream Postgres database changes to Apache Kafka and build a materialized view that updates in real time using ksqlDB.

March 4, 2024

by Evan Shortiss

· 2,723 Views · 2 Likes

What Is Incremental View Maintenance (IVM)?

Incremental View Maintenance (IVM) provides a method for keeping materialized views current by calculating and applying only incremental changes.

March 4, 2024

by hubert dulay

· 4,578 Views · 1 Like

Guarding the Gates of GenAI: Security Challenges in AI Evolution

This guide helps you understand the security challenges in GenAI Evolution and discusses robust measures to mitigate potential leaks, manipulation, and misuse.

March 4, 2024

by Phani Kumar Varma Kokkerlapati

· 3,962 Views · 4 Likes

Distributed Database Consistency Chat: PACELC, CAP Theorem, Raft, and Paxos

Last year, ScyllaDB's Kostja Osipov and Dr. Daniel Abadi, creator of the PACELC theorem, got together to chat about distributed database consistency.

March 4, 2024

by Cynthia Dunlop

CORE

· 1,875 Views · 1 Like

Beginner’s Guide to Vector Similarity Search

Let's explore the different techniques of vector similarity search such as Manhattan distance, Euclidean distance, Cosine distance and dot product.

March 4, 2024

by Pavan Belagatti

CORE

· 4,537 Views · 1 Like

Modern Microservices, Part 4: Decorator Pattern With gRPC Interceptors

In this guide to interceptors, explore a power gRPC facility for intercepting and modifying requests and responses (and streams) on a gRPC server.

March 4, 2024

by Sriram Panyam

· 5,105 Views · 2 Likes

Streaming the Super Bowl: The Art of Scaling Across Multiple Cloud Regions

In this tutorial, learn to build multi-region applications that scale and tolerate all sorts of possible outages.

March 4, 2024

by Denis Magda

CORE

· 2,971 Views · 2 Likes

Cloud Applications: A Step-By-Step Development Process

The cloud app development process brings a lot of convenience to modern businesses. It helps manage storage and performance issues to improve the end-user experience.

March 4, 2024

by Abhishek Mishra

· 3,588 Views · 1 Like

The Impact of AI on Software Testing

Explore the transformative effects of AI on software testing. From enhancing test automation to improving defect detection. Read how AI-driven testing works.

March 4, 2024

by Nishant Bijani

· 5,122 Views · 2 Likes

Logging and Monitoring in Google Cloud Platform (GCP)

Explore the importance of logging and monitoring in GCP, various options and best practices for logging and monitoring, and popular GCP services and tools.

March 4, 2024

by Aditya Bhuyan

· 4,112 Views · 2 Likes

Integrating Software Supply Chains and DevOps: Tips for Effectively Reconciling Supply Chain Management and DevOps

Enacting visibility, input, and accountability for both the development and operations teams ensures secure SSCs and provides an opportunity to strengthen DevOps culture.

March 3, 2024

by Justin Albano

CORE

· 9,138 Views · 2 Likes

Exploring Python Tools for Generative AI

Python, with its vast ecosystem of libraries and frameworks, serves as a powerful platform for exploring the boundless potential of generative AI.

March 1, 2024

by Apurva Kumar

· 6,519 Views · 3 Likes

Extractive Summarization With LLM Using BERT

Extractive summarization is a prominent technique in the field of NLP. Learn how you can pull key sentences out of a corpus of text using BERT Summarization.

March 1, 2024

by Kevin Vu

· 5,062 Views · 1 Like

Evaluating LLMs: Beyond Traditional Software Testing

LLM evaluation is constantly changing as the models improve; LLMs don't have simple right/wrong answers, making results subjective, so testing methods need to adapt.

March 1, 2024

by Ram N

· 5,417 Views · 3 Likes

Making Cloud Simpler: How Tangoe's AI and Patents Streamline FinOps

Simplify complicated cloud cost management with AI that optimizes usage and spending while freeing up architects and developers.

March 1, 2024

by Tom Smith

CORE

· 5,744 Views · 1 Like

AI Advancement for API and Microservices

AI advancements in API technology involve enhancing NLP capabilities, improving algorithmic decision-making through reinforcement learning, and expanding AI integration.

March 1, 2024

by Nilesh Charankar

· 6,238 Views · 3 Likes

The Latest Data Engineering Topics