Data Engineering Resources

A Brief History of Logical Replication in Postgres

Learn how the Postgres logical replication feature has evolved over the years, what the recent improvements are, and how the feature will likely change.

January 22, 2024

by Ahsan Hadi

· 1,793 Views · 1 Like

Private Cloud's Deployment

Software architecture to perform automated IAAS, PAAS, and SAAS deployments to private cloud with compliance, data privacy, and security.

January 22, 2024

by Joel Lopes

· 2,746 Views · 2 Likes

Release Management Risk Mitigation Strategies in Data Warehouse Deployments

In this article, learn how release management's proactive mitigation of risk enables deployments from development to production successfully despite numerous obstacles.

January 22, 2024

by Praveen Kumar Mannam

· 3,846 Views · 2 Likes

The Need for Secure Cloud Development Environments

Understand the need for secure Cloud Development Environments (CDEs) when onboarding developers quickly and securely in global development organizations.

January 22, 2024

by Laurent Balmelli, PhD

· 4,224 Views · 6 Likes

Katalyst: A QoS-Based Resource Management System for Workload Colocation on Kubernetes

Katalyst, by ByteDance, is an open-source resource management system with its own QoS for Kubernetes that optimizes resource use during off-peak hours.

January 22, 2024

by Pengcheng Tang

· 3,537 Views · 2 Likes

What Is JSON Schema?

We will discuss the importance of JSON Schema and explain how it relates to JSON. We’ll also review some common use cases for JSON Schema and walk through its benefits.

January 21, 2024

by Gbadebo Bello

· 2,166 Views · 1 Like

The Future of Big Data Analytics and Data Science: 10 Key Trends

Big data trends include real-time insights, automation, data quality, governance, cloud scalability, democratization, no-code, microservices, data mesh, and more.

January 21, 2024

by Deep Manishkumar Dave

· 5,719 Views · 1 Like

Protecting Your Digital Realm: Understanding Cybersecurity Threats and Defenses

Here's an expanded article on cybersecurity defense strategies, elaborating on various approaches, methods, and tools used to mitigate cyber threats and bolster digital defenses.

January 21, 2024

by Aditya Bhuyan

· 2,385 Views · 2 Likes

How To Base64 Encode or Decode Content Using APIs in Java

This article offers some high-level background for base64 encoding and provides several free API solutions for detecting, encoding and decoding base64 content.

January 21, 2024

by Brian O'Neill

CORE

· 5,140 Views · 6 Likes

Event-Based Autoscaling: Ensuring Smooth Operations on Your Peak Days

Automate event-based autoscaling with AI, preventing overprovisioning, optimizing performance, and enhancing user experience in diverse industries.

January 21, 2024

by Raj Nair

· 3,376 Views · 3 Likes

How Artificial Intelligence (AI) Is Transforming the Mortgage Industry

This article explores how AI has emerged as a game-changer, helping lenders and borrowers.

January 21, 2024

by Amrish Solanki

· 2,433 Views · 3 Likes

Generate a CRUD API Using Low-Code and No-Code

By combining a CRUD generator with declarative programming constructs, you can ALMOST eliminate the need for software developers - But only ALMOST!

January 21, 2024

by Thomas Hansen

CORE

· 2,520 Views · 2 Likes

How to Build a Data Foundation for Generative AI

GenAI depends on data maturity, in which an organization demonstrates mastery over both integrating data (moving and transforming it) and governing its use.

January 19, 2024

by Charles Wang

· 4,082 Views · 3 Likes

Microservices Architecture: Navigating the Buzz

What is all the talk around "microservices architecture" really about? This article breaks down the benefits and common challenges and offers some insight.

January 19, 2024

by Jasmine Taylor

· 5,202 Views · 6 Likes

AI for Web Devs: What Are Neural Networks, LLMs, & GPTs?

Good things to understand when building AI applications: artificial neural networks, LLMs, parameters, embeddings, GPTs, and hallucinations.

January 19, 2024

by Austin Gil

CORE

· 3,316 Views · 1 Like

Fast Analytics With MariaDB ColumnStore

Start your analytics journey with the open-source MariaDB relational database and the ColumnStore storage engine on Docker.

January 19, 2024

by Alejandro Duarte

CORE

· 66,777 Views · 2 Likes

Securing Digital Frontiers: The Essential Role of Network Access Control in Modern Cybersecurity

Network Access Control is key in barring unauthorized entries, improving network visibility, enhancing cybersecurity readiness, and aligns with the Zero Trust approach.

January 19, 2024

by Nitin Uttreja

· 3,759 Views · 1 Like

Unleashing the Power of Python: A Deep Dive into Data Visualization

Let's explore key factors contributing to Python's popularity in data visualization, including its open-source nature and integration with data analysis libraries.

January 19, 2024

by Arjun Karat

· 2,955 Views · 2 Likes

Protecting Privacy in the Age of Edge AI: The Role of Homomorphic Encryption

Homomorphic Encryption secures data in Edge AI, ensuring privacy. Rising IoT and privacy concerns drive Edge AI growth, aided by tech giants' privacy-centric approaches.

January 19, 2024

by Deep Manishkumar Dave

· 3,839 Views · 2 Likes

DataWeave Use Case

This blog is all about a use case that has some complex transformation and complex data structure. Here, we have an input JSON sample and the expected JSON sample.

January 19, 2024

by Muralidhar Gumma

· 2,604 Views · 1 Like

The Latest Data Engineering Topics