Data Engineering Resources

The Role of Kubernetes in Data Privacy and Protection

Kubernetes boosts data privacy and protection with secure container management, encryption, and access controls, ensuring safe data handling in modern applications.

June 20, 2024

by Michael Chukwube

· 6,233 Views · 2 Likes

Calculating Fingerprints for SQL Queries

Learn how to calculate a unique identifier for each SQL query in the database. See how we solved this challenge and what options we considered.

June 20, 2024

by Adam Furmanek

CORE

· 3,121 Views · 1 Like

Developer Git Commit Hygiene

This article will demonstrate good developer Git commit hygiene as well as educate the developer audience to use short and frequent commits.

June 20, 2024

by Gaurav Shekhar

· 4,646 Views · 7 Likes

IoT Needs To Get Serious About Security

Security issues in IoT have gotten worse, not better, and it's time we acknowledge that and fix it. It's long past time.

June 20, 2024

by David G. Simmons

CORE

· 7,023 Views · 3 Likes

Query-First Approach in Cassandra

Explore "query-first" in Cassandra, which focuses on how to search for information first, and then set up the database based on those searches or queries.

June 20, 2024

by Raja Chattopadhyay

· 2,439 Views · 1 Like

Improving Serialization and Memory Efficiency With a LongConverter

Chronicle Wire is an OSS library that makes it easier to work with fields encoding short strings and timestamps as 64-bit long.

June 20, 2024

by Peter Lawrey

· 4,622 Views · 1 Like

Unleashing the Power of Cloud Storage With JuiceFS

JuiceFS, a cloud-native file system, empowers enterprises with scalable, high-performance storage for data-intensive AI and analytics workloads.

June 20, 2024

by Tom Smith

CORE

· 3,513 Views · 2 Likes

How GitHub Codespaces Helps in Reducing Development Setup Time

Kickstart your journey with GitHub Codespaces and discover how it can significantly accelerate the environment setup process for developers.

June 19, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 10,001 Views · 2 Likes

Consuming GraphQL API With React.js

If you have created your GraphQL APIs and are looking to consume them in a React front-end, learn how to consume your GraphQL API using React.js in this post.

June 19, 2024

by Rose Chege

· 5,037 Views · 1 Like

Using CNTI/CNF Test Catalog for Non-Telco Cloud-Native Microservices

The CNTI/CNF Test Catalog is a versatile tool initially designed for telco applications but can also validate the cloud nativeness of non-telco microservices.

June 19, 2024

by Abhinav Garg

· 4,951 Views · 4 Likes

GenAI: Spring Boot Integration With LocalAI for Code Conversion

Learn how GenAI can be used locally or in private data centers using LocalAI, SpringBoot, and LangChain4J for code conversion tasks.

June 19, 2024

by Aftab Shaikh

· 6,657 Views · 3 Likes

Efficient Data Management With Offset and Cursor-Based Pagination in Modern Applications

Explore offset and cursor-based pagination, integrated with Jakarta Data, Quarkus, and MongoDB, highlighting their benefits and practical use in REST APIs.

June 19, 2024

by Otavio Santana

CORE

· 6,482 Views · 3 Likes

Building Powerful AI Applications With Amazon Bedrock: Enhanced Chatbots and Image Generation Use Cases

This article delves into the challenges faced by Chatbots and Image Generation, showcasing how AWS Bedrock empowers businesses to overcome them.

June 19, 2024

by Kishore Babu Karumanchi

· 3,305 Views · 2 Likes

A Wake-up Call for Cloud Security: Insights From the Recent Snowflake Data Breach

A case study on the recent Snowflake data breach and deep dive into cloud security measures to fortify cloud environments.

June 19, 2024

by Venkata Nedunoori

· 2,964 Views · 1 Like

MLOps in Software-Defined Vehicles: A Centralized Platform Approach

MLOps platforms are essential for managing ML models in software-defined vehicles, ensuring their effectiveness and long-term success.

June 18, 2024

by Pavan Vemuri

· 2,060 Views · 4 Likes

Tobiko Data: Revolutionizing Data Transformation With SQLMesh

Discover how Tobiko Data's SQLMesh is transforming the data landscape, enabling data scientists and analysts to build efficient and correct pipelines.

June 18, 2024

by Tom Smith

CORE

· 2,801 Views · 1 Like

A Framework for Building Semantic Search Applications With Generative AI

This article explores a framework for building semantic search applications with generative AI, enabling developers with a unified scalable framework.

June 18, 2024

by Lakshmanan Sethu Sankaranarayanan

· 2,147 Views · 3 Likes

Unmasking the Danger: 10 Ways AI Can Go Rogue (And How to Spot Them)

Large language models pose risks like manipulation, cyberattacks, and unintended self-improvement, but safeguards are being developed.

June 18, 2024

by Indrajit Bhattacharya

· 2,128 Views · 1 Like

Harnessing Kafka Streams for Seamless Data Tasks

Learn about the use of Kafka for convenient data exploration and dynamic data integration with its "publish-subscribe" model, organizing data into topics.

June 18, 2024

by Ilia Ivankin

· 4,204 Views · 1 Like

Random and Fixed Routes With Apache APISIX

Some triage on the APISIX repo led to the discovery of an interesting use case involving random and fixed routes. Explore the solution in this post.

June 18, 2024

by Nicolas Fränkel

CORE

· 1,796 Views · 1 Like

The Latest Data Engineering Topics