Data Engineering Resources

Optimizing Database Connectivity: A Comparative Analysis of Tomcat JDBC vs. HikariCP

Both Tomcat JDBC and HikariCP are connection pools for microservices. However, HikariCP offers more features and better performance.

May 21, 2024

by Naveen Pujari

· 8,195 Views · 26 Likes

Multi-Tenant Workload Isolation: A Better Balance Between Isolation and Utilization

Workload Group in Apache Doris supports CPU and memory resource isolation at a more granular level to increase utilization.

May 21, 2024

by Shirley H.

· 1,151 Views · 1 Like

Dynamic Watermarking of Bitmaps in Databases

Learn how to make the bitmaps in your database traceable, without changing your database or your applications.

May 20, 2024

by Max Tardiveau

· 4,091 Views · 10 Likes

Python Polars: Unleashing Speed and Efficiency for Large-Scale Data Analysis

Polars, a Python library, handles massive datasets with lightning speed, surpassing pandas in performance and memory management.

May 20, 2024

by Ganesh Kedari

· 2,702 Views · 2 Likes

Revolutionizing Machine Learning Pipelines: Google Cloud MLOps for Continuous Integration and Deployment

Google Cloud MLOps streamlines machine learning operations through automated CI/CD pipelines, scalable infrastructure, and comprehensive monitoring tools.

May 20, 2024

by Vijayabalan Balakrishnan

· 1,126 Views · 1 Like

7 Unique Ways To Use AI Tools for Data Analytics

Supplementing traditional methods of analyzing data with a variety of AI tools to help realize the potential of all available information.

May 20, 2024

by John Lafleur

· 1,216 Views · 1 Like

AI Risk Management Framework: A Technical Deep Dive for AI Developers

AI Risk Management Framework guides developers to build AI systems by identifying and mitigating risks through testing, secure coding, and continuous monitoring.

May 20, 2024

by Ram N

· 2,846 Views · 3 Likes

Using Primary, Partition, and Clustering Keys in ScyllaDB (or Cassandra)

Learn core data modeling concepts that are critical for optimizing performance in wide-column NoSQL databases.

May 20, 2024

by Guy Shtub

· 2,520 Views · 1 Like

10 Svelte Data Grids: Choose the Right One for Your Project

Explore these tips on how to choose the perfect data grid that can be seamlessly integrated into your next Svelte-based project.

May 20, 2024

by Alena Stasevich

· 6,320 Views · 3 Likes

HTTP API: Key Skills for Smooth Integration and Operation, Part 2

Explore how data handling concepts apply in real-world scenarios as well as the importance of these skills, instrumental in ensuring project stability.

May 20, 2024

by Filipp Shcherbanich

CORE

· 1,816 Views · 3 Likes

How to Iterate Over Multiple Lists Sequentially in Python

Do you need to process items of multiple Python lists in one go? Here are some simple ways to do this using the itertools library and for loop.

May 20, 2024

by Sreeram Sreenivasan

· 10,273 Views · 1 Like

Harnessing the Power of AI in Compliance Automation: Insights from Shrav Mehta, Founder and CEO, Secureframe

Discover how AI transforms compliance automation, its challenges, and best practices for developers, engineers, and architects.

May 20, 2024

by Tom Smith

CORE

· 1,051 Views · 1 Like

KEDA: Kubernetes Event Driven Auto-Scaling in Azure Kubernetes Services (AKS)

AutoScaling is a cloud computing feature that allows you to automatically adjust the capacity of your resources based on actual workload.

May 18, 2024

by Gaurav Shekhar

· 1,750 Views · 1 Like

GenAI Demo With Kafka, Flink, LangChain and OpenAI

Explore the architecture and demo for open-source data streaming using Apache Kafka and Flink with Python, LangChain, and OpenAI LLM APIs in the cloud.

May 17, 2024

by Kai Wähner

CORE

· 3,586 Views · 1 Like

GenAI in Java With Merlinite, Quarkus, and Podman Desktop AI Lab

Discover the simple and easy way to quickly get up and running with containerized LLMs and AI-infused Quarkus applications in Java.

May 17, 2024

by Markus Eisele

· 4,513 Views · 1 Like

How To Build Local LLM Apps With Ollama and SingleStore

In this article, we will explore how to use Ollama with LangChain and SingleStore using a Jupyter Notebook.

May 17, 2024

by Akmal Chaudhri

CORE

· 3,138 Views · 2 Likes

Distributed Systems: Common Pitfalls and Complexity

The complexity of distributed systems is an important challenge. In this post, explore the types of complexity you may encounter and effective tactics to use.

May 17, 2024

by Aleksei Popov

· 35,857 Views · 4 Likes

Advancements in AI for Health Data Analysis

Healthcare has ushered in a transformative era dominated by AI and ML, which are now central to data analytics and operational utilities.

May 17, 2024

by Saigurudatta Pamulaparthyvenkata

· 4,411 Views · 6 Likes

RocksDB: The Bedrock of Modern Stateful Applications

Apache Flink, Kafka Streams, and Apache Kvrocks use RocksDB as a persistent layer. Consider before embarking on the creation of your own data storage engine; use RocksDB.

May 16, 2024

by Mark Andreev

· 2,819 Views · 2 Likes

Create Proxy Application for Mule APIs

In this article, we will learn what a proxy is and discuss how to configure a proxy application for the MuleSoft Application using API Manager in the Anypoint Platform.

May 16, 2024

by Vidya Bogaram

· 5,086 Views · 1 Like

The Latest Data Engineering Topics