Data Engineering Resources

Exploring Apache Airflow for Batch Processing Scenario

In this article, let's explore a simple use case of processing an input file and writing back to the output file using Apache Airflow.

November 30, 2023

by kalpesh barde

· 11,750 Views · 5 Likes

Accelerating Insights With Couchbase Columnar

Insights come from observing and analyzing data from all sources. Couchbase Columnar helps quickly analyze data from a variety of data sources with zero-ETL.

November 30, 2023

by Keshav Murthy

CORE

· 3,926 Views · 2 Likes

Unleashing Conversational Magic: Integrating ChatGPT With React.js and Node.js

In this comprehensive guide, we'll explore the integration of ChatGPT with a powerful duo: React.js on the frontend and Node.js on the backend.

November 30, 2023

by Atul Naithani

· 4,244 Views · 3 Likes

Maximizing Business Benefits: Building Microservices Architecture in Azure

The Azure platform offers managed services, infrastructure, and end-to-end developer tools that can be used to create microservices applications.

November 30, 2023

by Kapil Rawal

· 3,966 Views · 2 Likes

Empowering Secure Access: Unleashing the Potential of Microsoft Entra ID Application Proxy

Azure Entra ID Application Proxy can seamlessly integrate with your on-premises workload to redefine how enterprises manage and secure their applications.

November 30, 2023

by Shivaprasad Sankesha Narayana

· 3,595 Views · 4 Likes

Exploring ML.NET Catalogs and Use Cases

This overview for machine learning beginners focuses on the concept of catalogs in ML.NET, a cross-platform, open-source ML framework for .NET developers.

November 30, 2023

by Somasundaram Kumarasamy

· 6,406 Views · 1 Like

Data Management for Customer Relationship Management (CRM)

Explore effective data management strategies for CRM systems, focusing on data types, integration methods, security, and AI's role in enhancing CRM efficiency.

November 30, 2023

by Theresa Campbell

· 1,998 Views · 1 Like

Data Management and Blockchain Technology

Explore how blockchain transforms data management with enhanced security, transparency, and interoperability. A game-changing synergy for future tech!

November 30, 2023

by Pamela Price

· 2,346 Views · 1 Like

Build a Philosophy Quote Generator With Vector Search and Astra DB (Part 3)

In the final installment of this series, complete the quote generator application by using an LLM to generate philosophical quotes.

November 30, 2023

by Stefano Lottini

· 2,518 Views · 1 Like

Chopping the Monolith in a Smarter Way

In this post, I offer another alternative to chop the monolith. Instead of forking the call on the client side, we fork the call on the Gateway side.

November 30, 2023

by Nicolas Fränkel

· 1,977 Views · 2 Likes

API World 2023: Bringing Together API, AI, and Secrets Security

API World 2023 was about sharing insights on best practices, accounting for all your assets, and the importance of AI and API cybersecurity in an API-driven world.

November 30, 2023

by Dwayne McDaniel

· 2,263 Views · 2 Likes

Configuring Spark-Submit

Maximize Apache Spark. Fine-tune configurations, allocate resources, and seamlessly integrate for optimal big data processing.

November 30, 2023

by Dheeraj Gupta

· 14,479 Views · 3 Likes

Best Methods To Backup and Restore Database in SQL Server

Explore methods to back up and restore the Database in the SQL Server. Get the complete solutions to Backup and Restore Database in SQL Server.

November 30, 2023

by Mithilesh Tata

CORE

· 3,030 Views · 1 Like

Decompose Legacy System Into Microservices: Part 2

In this article, follow along with a breakdown of a legacy insurance Reimbursement Calculation System into microservices in a domain-specific example.

November 29, 2023

by Somasundaram Kumarasamy

· 5,866 Views · 3 Likes

Building a Real-Time Slackbot With Generative AI

Learn how to build a cool Slackbot with Apache NiFi, LLM, Foundation Models, and streaming. We will cover model choices and integration.

November 29, 2023

by Tim Spann

CORE

· 3,586 Views · 5 Likes

IoT Cloud Computing in IoT: Benefits and Challenges Explained

In this article, you'll gain insights into the advantages, challenges, and pivotal role of cloud computing in the IoT ecosystem.

November 29, 2023

by Serhii Orlivskyi

· 5,744 Views · 2 Likes

Connecting the Dots: Unraveling IoT Standards and Protocols

MQTT facilitates efficient messaging, HTTP/HTTPS connects devices, and TLS ensures secure data exchange—integral components shaping the IoT's future.

November 29, 2023

by Animesh Patel

· 3,862 Views · 2 Likes

From Sprout to Sequoia: Orchestrating the Symphony of IoT Growth and Cloud Scalability

The IoT's evolution, from sprout to sequoia, is orchestrated by scalable cloud growth, fostering resilience, connectivity, and integration with AI.

November 29, 2023

by Animesh Patel

· 3,786 Views · 2 Likes

Demystifying Databases, Data Warehouses, Data Lakes, and Data Lake Houses

Databases for transactions, data warehouses for analytics, and data lakes and lake houses for analytics with flexibility and scalability.

November 29, 2023

by Anirudha Bhadoriya

· 4,575 Views · 9 Likes

IoT and Embedded Systems: A Brief Analysis

IoT(Internet of Things) relies on embedded systems as its foundational technology, utilizing their optimized hardware and software to process specific tasks.

November 29, 2023

by Mohit Dwivedi

· 3,269 Views · 2 Likes

The Latest Data Engineering Topics