Data Resources

Detecting Patterns in Event Streams With FlinkCEP

Patterns play a big role in ESP as they help to spot important sequences or behaviors in data that keep flowing nonstop.

February 5, 2025

by Gautam Goswami

CORE

· 6,583 Views · 2 Likes

Mastering the Transition: From Amazon EMR to EMR on EKS

Optimize your data processing by seamlessly transitioning from Amazon EMR to EMR on EKS. Discover best practices and tips for a smooth migration.

February 5, 2025

by Satrajit Basu

CORE

· 7,132 Views · 4 Likes

Build a Stateless Microservice With GitHub Copilot in VSCode

In this guide, we will build a stateless Flask Microservice using GitHub Copilot, with its benefits, speed, and where to be cautious when using it.

February 5, 2025

by Sibasis Padhi

· 8,722 Views · 7 Likes

Teradata Performance and Skew Prevention Tips

Use unique identifiers such as Teradata Primary Index to evenly distribute data across AMPs to improve database performance by 70%.

February 4, 2025

by Sudheer Kumar Lagisetty

· 4,356 Views · 10 Likes

Data Governance Essentials: Policies and Procedures (Part 6)

Learn how data quality, policies, and procedures strengthen data governance by ensuring accuracy, compliance, and security for better decision-making.

February 4, 2025

by Sukanya Konatam

· 5,620 Views · 4 Likes

Processing Cloud Data With DuckDB And AWS S3

DuckDB's ability to read data directly from cloud storage, such as AWS S3, makes it particularly powerful for modern data architectures.

February 4, 2025

by Anil Kumar Moka

· 14,414 Views

SOC 2 Made Simple: Your Guide to Certification

This guide breaks down the SOC 2 Type 2 certification process into practical steps, from preparation to the audit, with some tips and tools to make the journey smoother.

February 4, 2025

by Roman Misyurin

· 4,070 Views · 3 Likes

Best Practices for API Rate Limits and Quotas

Rate limits protect your infrastructure, and quotas help you monetize your APIs. Both are key parts of a healthy API strategy.

February 3, 2025

by Derric Gilling

CORE

· 6,564 Views · 1 Like

All You Need to Know About Apache Spark

Apache Spark is a fast, open-source cluster computing framework for big data, supporting ML, SQL, and streaming. It’s scalable, efficient, and widely used.

February 3, 2025

by Abhishek Trehan

· 4,245 Views · 2 Likes

90% Cost Reduction With Prefix Caching for LLMs

Up to 70% of prompts in LLM applications are repetitive. Prefix caching can reduce inference costs by up to 90%, thus optimizing performance and saving money.

February 3, 2025

by Mahak Shah

· 4,674 Views

Pydantic: Simplifying Data Validation in Python

Pydantic is a powerful Python library that uses type annotations to validate data structures. Learn about the powerful features of Pydantic with code examples.

February 3, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 3,383 Views · 6 Likes

The Quest for HA and DR in Loki

Minimize data loss and business disruption by implementing high availability and configuring disaster recovery for Loki with AWS S3 as the object store.

January 31, 2025

by Pavan N G

· 4,114 Views · 1 Like

Creating a Service for Sensitive Data With Spring and Redis

In some cases, one cannot store user-sensitive data permanently. Let's create a simple application that handles sensitive data leveraging Spring and Redis.

January 31, 2025

by Alexander Rumyantsev

· 5,014 Views · 2 Likes

Building a Machine Learning Pipeline Using PySpark

This article discusses building an efficient ML pipeline with PySpark, covering data loading, preprocessing, model training, and evaluation for large datasets.

January 30, 2025

by Abhishek Trehan

· 5,175 Views · 1 Like

Bridging Graphviz and Cytoscape.js for Interactive Graphs

Making Graphviz static digraphs interactive and compatible with Cytoscape by converting DOT format graphs into Cytoscape JSON using Python.

January 30, 2025

by Puneet Malhotra

· 4,270 Views · 1 Like

SmartXML: An Alternative to XPath for Complex XML Files

We'll discuss SmartXML, an XPath alternative for parsing complex XML files, converting them to SQL, and loading the results into a database seamlessly.

January 30, 2025

by Luca Sanders

· 5,686 Views · 2 Likes

Scaling Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 30, 2025

by Ganapathy Subramanian Ramachandran

· 2,807 Views

Metal and the Simulated Annealing Algorithm

The Simulated Annealing algorithm described in this article demonstrates its effectiveness as a powerful tool for finding optimal solutions to complex problems.

January 29, 2025

by Vitaly Kuznetsov (Ippolitov)

· 3,199 Views · 2 Likes

Scrape Amazon Product Reviews With Python

Let's learn how we can implement Python and Python scripts to scrape the Amazon website in an ethical way to extract product review data.

January 29, 2025

by Juveria dalvi

· 2,813 Views · 2 Likes

Implement RAG With PGVector, LangChain4j, and Ollama

Apply vector search and RAG experiments to enhance query results and optimize data storage for text embeddings, specifically with Bruce Springsteen's album data.

January 28, 2025

by Gunter Rotsaert

CORE

· 3,000 Views · 2 Likes

The Latest Data Topics