Data Engineering Resources

How We Achieved a 40x Performance Boost in Metadata Backup and Recovery

Discover how JuiceFS achieved a 40x performance boost in metadata backup and recovery, reducing runtime and memory usage of dump and load operations.

January 30, 2024

by jiaxing duan

· 1,694 Views · 1 Like

AI for Web Devs: AI Image Generation

In this post, we create a Dialog component with Qwik before I share my strategy for dealing with the nuances of AI image generation with OpenAI.

January 30, 2024

by Austin Gil

CORE

· 1,815 Views · 1 Like

Why Can’t I Find the Right Data?

This post dives into data catalogs and why they fall short of overcoming the fragmentation to deliver a fully self-served data discovery experience.

January 30, 2024

by Pardhu Gunnam

· 1,778 Views · 3 Likes

Clean Data, Clear Insights: How Web Data Cleaning Elevates Decision-Making

The article discusses why web data cleaning is challenging and shares practical tips for companies considering buying ready-to-use, cleaned datasets from data suppliers.

January 30, 2024

by Karolis Didziulis

· 2,032 Views · 2 Likes

Bringing Order to Chaos: How CloudFabrix Streamlines Work for Technology Professionals

Data fabric unifies insights across domains, cuts through chaos with AI-assisted analytics, and provides agility with automated service assurance.

January 30, 2024

by Tom Smith

CORE

· 2,684 Views · 2 Likes

Successful Products Using Raspberry Pi Computing Model

This article explores some of the remarkable products that have harnessed the power of the Raspberry Pi, demonstrating its adaptability and robust capabilities.

January 30, 2024

by Aditya Bhuyan

· 2,262 Views · 2 Likes

Edge Security for IoT: Protecting Data at the Edge

In the world of IoT, edge security is crucial. This article explores the unique security challenges and strategies for safeguarding IoT data and devices at the edge.

January 29, 2024

by Deep Manishkumar Dave

· 2,822 Views · 1 Like

Lost in Translation: Gaps of GPT-3.5 in South Asian and Middle Eastern Languages

This article reveals disparities in performance, including grammatical errors and inappropriate tone, in responses to non-English prompts in LLMs like GPT-3.5.

January 29, 2024

by Amritha Arun Babu Mysore

· 2,657 Views · 4 Likes

Strategies and Guidance for Effective Cloud Management and Cost Optimization

This guide offers comprehensive strategies to not only reduce operational expenses but also enhance overall efficiency.

January 29, 2024

by Mandeep Kaur

· 3,026 Views · 3 Likes

O11y Guide, Cloud-Native Observability Pitfalls: Controlling Costs

In part 2 of this series, take a look at how to control the costs and the broken cost models encountered with cloud-native observability.

January 29, 2024

by Eric D. Schabell

CORE

· 2,930 Views · 3 Likes

Data Governance and DevOps

This article talks about data governance processes and its importance and how a DevOps mindset can improve its efficiency.

January 29, 2024

by Yashraj Behera

· 3,093 Views · 1 Like

Empowering Inclusivity: Utilizing Edge ML to Support Individuals With Special Needs

This article covers Edge Machine Learning (Edge ML) for special needs, including its advantages and ethical considerations.

January 29, 2024

by shiva kumar sriramulugari

· 5,579 Views · 2 Likes

Shaping the Future: Key Trends Transforming Mobile Apps

Emerging technologies like 5G, AI, AR, VR, blockchain, and IoT are significantly transforming mobile app development, enhancing speed, personalization, and interactivity.

January 29, 2024

by Dmitry Taraev

· 45,766 Views · 93 Likes

Simplify Big Data Analytics With AirMettle

100x faster SQL queries without warehouses. The software-defined approach runs on commodity hardware both on-premises and in the cloud.

January 29, 2024

by Tom Smith

CORE

· 2,128 Views · 1 Like

Developing With Dragonfly: Solve Caching Problems

Investigate three frequently encountered caching challenges and delve into the most effective best practices to successfully mitigate them.

January 29, 2024

by Joe Zhou

· 1,441 Views · 1 Like

MongoDB and PostgreSQL Support for NestJS Boilerplate

Learn how to implement it with hexagonal architecture. How to choose what DB works better for your project and how to set up your NestJS project properly.

January 29, 2024

by Rodion Salnik

· 1,604 Views · 1 Like

Community Hardware Used in Cloud Computing

In this comprehensive article, we will explore the various community hardware components used in cloud computing and how they contribute to the industry's evolution.

January 29, 2024

by Aditya Bhuyan

· 2,605 Views · 2 Likes

Artificial Intelligence in IT and Project Management

Artificial Intelligence adoption in IT organizations is creating new challenges and opportunities for program and project management.

January 29, 2024

by Navdeep Malik

· 3,071 Views · 5 Likes

Optimizing Data Management: Migrating From AWS RDS MySQL to Snowflake

If you're seeking a modern, innovative, and scalable approach to managing your data operations, AWS RDS just might be the solution you've been searching for.

January 29, 2024

by Sandeep Rangineni

· 2,228 Views · 3 Likes

What To Expect For AI in 2024

The year 2023 has brought great innovation in the AI field. What novelties should you expect to see this coming year 2024?

January 29, 2024

by Roger Oriol

· 1,472 Views · 1 Like

The Latest Data Engineering Topics