Data Engineering Resources

Explore an intro to bare-metal software development for smart devices based on the ARM Cortex-M series of micro-controllers using open-source tools.

May 21, 2024

by Shobhit Kukreti

· 3,054 Views · 2 Likes

Rediscovering DevOps’ Heartbeat With Secure Cloud Development Environments

How to rethink the implementation of the core DevOps principles of flow, feedback, and continuous learning using secure cloud development environments.

May 21, 2024

by Laurent Balmelli, PhD

· 1,128 Views · 2 Likes

Optimizing Database Connectivity: A Comparative Analysis of Tomcat JDBC vs. HikariCP

Both Tomcat JDBC and HikariCP are connection pools for microservices. However, HikariCP offers more features and better performance.

May 21, 2024

by Naveen Pujari

· 8,462 Views · 26 Likes

Multi-Tenant Workload Isolation: A Better Balance Between Isolation and Utilization

Workload Group in Apache Doris supports CPU and memory resource isolation at a more granular level to increase utilization.

May 21, 2024

by Shirley H.

· 1,239 Views · 1 Like

Dynamic Watermarking of Bitmaps in Databases

Learn how to make the bitmaps in your database traceable, without changing your database or your applications.

May 20, 2024

by Max Tardiveau

· 4,205 Views · 10 Likes

Python Polars: Unleashing Speed and Efficiency for Large-Scale Data Analysis

Polars, a Python library, handles massive datasets with lightning speed, surpassing pandas in performance and memory management.

May 20, 2024

by Ganesh Kedari

· 2,841 Views · 2 Likes

Revolutionizing Machine Learning Pipelines: Google Cloud MLOps for Continuous Integration and Deployment

Google Cloud MLOps streamlines machine learning operations through automated CI/CD pipelines, scalable infrastructure, and comprehensive monitoring tools.

May 20, 2024

by Vijayabalan Balakrishnan

· 1,170 Views · 1 Like

7 Unique Ways To Use AI Tools for Data Analytics

Supplementing traditional methods of analyzing data with a variety of AI tools to help realize the potential of all available information.

May 20, 2024

by John Lafleur

· 1,292 Views · 1 Like

AI Risk Management Framework: A Technical Deep Dive for AI Developers

AI Risk Management Framework guides developers to build AI systems by identifying and mitigating risks through testing, secure coding, and continuous monitoring.

May 20, 2024

by Ram N

· 3,029 Views · 3 Likes

Using Primary, Partition, and Clustering Keys in ScyllaDB (or Cassandra)

Learn core data modeling concepts that are critical for optimizing performance in wide-column NoSQL databases.

May 20, 2024

by Guy Shtub

· 2,614 Views · 1 Like

10 Svelte Data Grids: Choose the Right One for Your Project

Explore these tips on how to choose the perfect data grid that can be seamlessly integrated into your next Svelte-based project.

May 20, 2024

by Alena Stasevich

· 6,426 Views · 3 Likes

HTTP API: Key Skills for Smooth Integration and Operation, Part 2

Explore how data handling concepts apply in real-world scenarios as well as the importance of these skills, instrumental in ensuring project stability.

May 20, 2024

by Filipp Shcherbanich

CORE

· 1,931 Views · 3 Likes

How to Iterate Over Multiple Lists Sequentially in Python

Do you need to process items of multiple Python lists in one go? Here are some simple ways to do this using the itertools library and for loop.

May 20, 2024

by Sreeram Sreenivasan

· 10,527 Views · 1 Like

Harnessing the Power of AI in Compliance Automation: Insights from Shrav Mehta, Founder and CEO, Secureframe

Discover how AI transforms compliance automation, its challenges, and best practices for developers, engineers, and architects.

May 20, 2024

by Tom Smith

CORE

· 1,125 Views · 1 Like

KEDA: Kubernetes Event Driven Auto-Scaling in Azure Kubernetes Services (AKS)

AutoScaling is a cloud computing feature that allows you to automatically adjust the capacity of your resources based on actual workload.

May 18, 2024

by Gaurav Shekhar

· 1,834 Views · 1 Like

GenAI Demo With Kafka, Flink, LangChain and OpenAI

Explore the architecture and demo for open-source data streaming using Apache Kafka and Flink with Python, LangChain, and OpenAI LLM APIs in the cloud.

May 17, 2024

by Kai Wähner

CORE

· 3,658 Views · 1 Like

GenAI in Java With Merlinite, Quarkus, and Podman Desktop AI Lab

Discover the simple and easy way to quickly get up and running with containerized LLMs and AI-infused Quarkus applications in Java.

May 17, 2024

by Markus Eisele

· 4,807 Views · 1 Like

How To Build Local LLM Apps With Ollama and SingleStore

In this article, we will explore how to use Ollama with LangChain and SingleStore using a Jupyter Notebook.

May 17, 2024

by Akmal Chaudhri

CORE

· 3,366 Views · 2 Likes

Distributed Systems: Common Pitfalls and Complexity

The complexity of distributed systems is an important challenge. In this post, explore the types of complexity you may encounter and effective tactics to use.

May 17, 2024

by Aleksei Popov

· 36,086 Views · 4 Likes

Advancements in AI for Health Data Analysis

Healthcare has ushered in a transformative era dominated by AI and ML, which are now central to data analytics and operational utilities.

May 17, 2024

by Saigurudatta Pamulaparthyvenkata

· 4,546 Views · 6 Likes

The Latest Data Engineering Topics