Data Engineering Resources

Shingling for Similarity and Plagiarism Detection

This article introduces you to the concept of shingling, the basics of the shingling technique, Jaccard similarity, advanced techniques, and optimizations.

June 25, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 7,702 Views · 4 Likes

When Not To Use Apache Kafka (Lightboard Video)

When not to use Apache Kafka, do's and don't's; no matter if you use open source, Confluent, Amazon MSK, Event Hubs, Redpanda, Warpstream, et al.

June 25, 2024

by Kai Wähner

CORE

· 3,190 Views · 1 Like

Index Engines’ Cybersense Delivers Unparalleled Ransomware Detection With 99.99% Accuracy

Index Engines announces an industry-first 99.99% SLA for CyberSense to accurately detect ransomware corruption, empowering organizations with smarter recovery strategies.

June 25, 2024

by Tom Smith

CORE

· 2,783 Views · 1 Like

Advanced SQL for Data Engineering

Advanced SQL is a powerful tool that allows you to retrieve, analyze, and manipulate large amounts of data in a structured and efficient way.

June 25, 2024

by Harsh Daiya

CORE

· 8,220 Views · 7 Likes

FAISS, developed by Facebook AI, is an efficient library for similarity search and clustering of high-dimensional vector data, optimizing machine learning applications.

June 25, 2024

by Lalithkumar Prakashchand

· 4,163 Views · 2 Likes

Query SQL and NoSQL Databases Using Artificial Intelligence

Learn how to use artificial intelligence to query database tables with simple user input.

June 24, 2024

by Danny Logsdon

· 4,499 Views · 3 Likes

Open-Source Dapr for Spring Boot Developers

Using Dapr with Spring Boot simplifies the development for Dapr-enabled apps: run, test, and debug locally without the need to run inside a K8s cluster.

June 24, 2024

by Thomas Vitale

· 10,257 Views · 5 Likes

Why I Chose Supabase as BaaS for My Projects

Supabase is a promising platform for developing serverless applications, ideal for indie developers and startups. Learn more!

June 24, 2024

by Egor Dubchenko

· 3,945 Views · 2 Likes

Steps To Industry-Leading Query Speed: Evolution of the Apache Doris Execution Engine

From the Volcano Model to the Pipeline Execution Engine, and now PipelineX, Apache Doris brings its computation efficiency to a higher level with each iteration.

June 24, 2024

by Shirley H.

· 2,087 Views · 1 Like

Mastering Unstructured Data Chaos With Datadobi StorageMAP 7.0

StorageMAP 7.0 simplifies unstructured data management, enabling infrastructure optimization, AI data feeds, data resilience, and operational excellence.

June 24, 2024

by Tom Smith

CORE

· 2,876 Views · 1 Like

Optimizing InfiniBand Bandwidth Utilization for NVIDIA DGX Systems Using Software RAID Solutions

Leveraging SPDK vhost-blk with software RAID on NVIDIA DGX systems significantly improves InfiniBand bandwidth utilization and performance.

June 24, 2024

by Sergey Platonov

· 2,895 Views · 1 Like

MaxLinear Empowers High-Speed Connectivity and Data Acceleration Solutions for Next-Gen Computing

Advanced connectivity solutions and Panther III storage accelerator empower software engineers to build high-performance, data-driven computing systems.

June 22, 2024

by Tom Smith

CORE

· 4,219 Views · 1 Like

Books To Start Your Career in Cloud, DevOps, or SRE in 2024

A useful list of books to learn all trending skills in DevOps, Site Reliability, or Production Engineering. This post will also cover tech skills for a strong foundation.

June 21, 2024

by Anuj Tyagi

· 13,742 Views · 6 Likes

Block Size and Its Impact on Storage Performance

Explore structured vs unstructured data, how storage segments react to block size changes, and differences between I/O-driven and throughput-driven workloads.

June 21, 2024

by Jaswinder Singh Saini

· 10,089 Views · 4 Likes

Migrating Data From Amazon Neptune to PostgreSQL Using AWS Services

This article provides a step-by-step guide on how to migrate data from Amazon Neptune, a graph database service, to PostgreSQL, a relational database service.

June 21, 2024

by Bhanuprakash Jirra

· 4,940 Views · 2 Likes

How To Compare DOCX Documents in Java

In this article, learn how to carry out DOCX comparisons programmatically by calling a specialized web API with Java code examples.

June 21, 2024

by Brian O'Neill

CORE

· 11,390 Views · 4 Likes

Optimizing Your Cloud Resources, Part 2: Resource Management via IBM Cloud Projects

A collection of configurations used to organize and manage the Infrastructure as Code (IaC) deployments and related resources across multiple accounts.

June 21, 2024

by Josephine Eskaline Joyce, Ph.D

CORE

· 3,346 Views · 3 Likes

When You Need More Power Than a Lambda Provides

While I appreciate the concept of a serverless option, sometimes you simply need more power. Let’s explore an alternative that doesn’t break your project’s budget.

June 21, 2024

by John Vester

CORE

· 69,708 Views · 2 Likes