Data Engineering Resources

Causes and Remedies of Poison Pill in Apache Kafka

A poison pill is a message deliberately sent to a Kafka topic, designed to consistently fail when consumed, regardless of the number of consumption attempts.

September 25, 2023

by Gautam Goswami

CORE

· 7,331 Views · 3 Likes

Gossips on Cryptography: Part 1 and 2

In this blog series, we will cover the basics of cryptography, including encryption and decryption. We'll start by discussing the origins of cryptography.

September 25, 2023

by Sahil Aggarwal

· 3,061 Views · 2 Likes

MQTT Sparkplug: Bridging IT and OT in Industry 4.0

By leveraging MQTT Sparkplug, businesses can unlock real-time data insights, improve operational efficiency, and drive innovation in their industrial processes.

September 25, 2023

by Kary Ware

· 2,238 Views · 2 Likes

WordPress Deployment: Docker, Nginx, Apache, and SSL

Install and set up WordPress with Docker Compose, Nginx, Apache, and Let's Encrypt SSL on Ubuntu 22.04 LTS. This setup is tested on a Google Cloud Compute Engine VM.

September 25, 2023

by Pappin Vijak

· 8,930 Views · 2 Likes

Designing Databases for Distributed Systems: Data Management Patterns for Microservices and Cloud-Native Applications

Several data management patterns have emerged for microservices and cloud-native solutions. Learn important patterns to manage data in a distributed environment.

September 25, 2023

by Saurabh Dashora

CORE

· 16,808 Views · 15 Likes

Implementing Stronger RBAC and Multitenancy in Kubernetes Using Istio

Learn how to use Istio service mesh on top of K8s auth to implement stronger RBAC and multitenancy for Kubernetes workloads.

September 25, 2023

by Debasree Panda

· 6,552 Views · 7 Likes

How to Deploy a Startup Script to an Integration Server Running in an IBM Cloud Pak for Integration Environment

In this article, we explain how to use a startup script to auto-restart Integration Server pods in a Cloud Pak for Integration environment.

September 25, 2023

by Dave Crighton

· 5,522 Views · 3 Likes

Hugging Face Is the New GitHub for LLMs

Hugging Face is becoming the "GitHub" for large language models (LLMs). Hugging Face offers tools that simplify LLM development and deployment.

September 24, 2023

by Arvind Bhardwaj

· 4,500 Views · 1 Like

Best GitHub-Like Alternatives for Machine Learning Projects

Let’s look at some platforms and sites similar to GitHub that offer robust features and functionalities, which can easily give GitHub a fight.

September 22, 2023

by Or Hillel

· 5,648 Views · 1 Like

TypeScript: Useful Features

Some advanced constructs may require a learning curve, but can significantly bolster your type safety. This article introduces you to some of these advanced features.

September 22, 2023

by Vasyl Mysiura

· 7,757 Views · 3 Likes

When To Boost Your Authentication Strategy: Signs for Security Enhancement

Businesses embarking on a digital transformation journey shouldn’t ignore the importance of a robust authentication strategy as a part of their growth strategy.

September 22, 2023

by Deepak Gupta

· 3,850 Views · 1 Like

API Design

API design ensures efficient communication between software systems. It involves simplicity, consistency, security, and thorough documentation.

September 22, 2023

by Elsie Tyler

· 4,745 Views · 2 Likes

The State of Data Streaming for Digital Natives (Born in the Cloud)

Explore digital natives born in the cloud, leverage Apache Kafka for innovation and new business models, and discover trends, architectures, and case studies.

September 22, 2023

by Kai Wähner

CORE

· 4,283 Views · 4 Likes

Reducing AI Hallucinations With Retrieval Augmented Generation

This newly devised technique shows promise in increasing the knowledge of LLMs by enabling prompts to be augmented with proprietary data.

September 22, 2023

by Alex Leventer

· 3,508 Views · 1 Like

How AI Helped Us Add Vector Search to Cassandra in Six Weeks

DataStax had to move fast to add this foundational AI-enablement feature. Here’s how ChatGPT, Copilot, and other AI tools helped us build the code.

September 22, 2023

by Jonathan Ellis

· 3,140 Views · 1 Like

Using PostgreSQL® JSON Functions To Navigate Reviews of Restaurants in India

Parsing semi-structured dataset in a relational database seems scary. Read on for how PostgreSQL® JSON functions allow your SQL queries to work with json and jsonb data.

September 22, 2023

by Francesco Tisiot

· 2,800 Views · 1 Like

How TIBCO Is Evolving Integration for the Multi-Cloud Era

Single pane of glass end-to-end observability, a developer portal, model-driven data management, and virtualization boost productivity and performance.

September 22, 2023

by Tom Smith

CORE

· 4,737 Views · 3 Likes

What Is Good Database Design?: Modern Data Architecture Considerations, Challenges, and Recommendations

Find out how good database design is essential to ensure data accuracy, consistency, and integrity and that databases are efficient, reliable, and easy to use.

September 22, 2023

by Manas Dash

CORE

· 17,098 Views · 10 Likes