Data Engineering Resources

Exploring the Dynamics of Streaming Databases

This article explores what a streaming database is, as it is the core component of a stream processing system, and describes some available solutions.

June 11, 2024

by Federico Trotta

· 6,101 Views · 3 Likes

Choosing the Optimal Data Storage Architecture

Explore the differences between a Data Warehouse, Data Lake, and Data Lakehouse architectures to choose the best fit for your business needs.

June 10, 2024

by Den Smyrnov

· 2,708 Views · 1 Like

Navigating the Maze: Evolving Projects and Database Dilemmas

Exploring the complexities of managing projects and the challenges posed by database management. Delving into strategies for navigating these issues.

June 10, 2024

by Bohdan Snisar

· 2,242 Views · 2 Likes

JavaScript, Node.js, and Apache Kafka for Full-Stack Data Streaming

Explore JavaScript, Node.js, and Apache Kafka for full-stack development for data streaming with open-source clients.

June 10, 2024

by Kai Wähner

CORE

· 7,592 Views · 2 Likes

Twilio Empowers Developers With Enhanced Data Warehouse Interoperability

Linked Audiences and Segment Data Graph revolutionize customer engagement by unlocking the full potential of data warehouses for developers and marketers.

June 10, 2024

by Tom Smith

CORE

· 2,609 Views · 1 Like

Exploring WebAssembly for Cloud-Native Development

Learn about WebAssembly's potential for cloud-native development, near-native speed, polyglot capabilities, and advancements like WebAssembly 2.0 and Spin.

June 10, 2024

by Thang Chung

· 4,589 Views · 2 Likes

Snowflake Empowers Developers to Easily Build Data-Driven Apps and Chatbots

The unified platform, AI capabilities, and tools like Snowpark and Streamlit enable developers to rapidly create intelligent, data-driven apps and chatbots.

June 9, 2024

by Tom Smith

CORE

· 3,370 Views · 1 Like

Harnessing the Power of Gen AI: Real-World Applications and Best Practices

Unlock the power of Gen AI with real-world applications, best practices, and strategies for driving business value while navigating the hype.

June 8, 2024

by Tom Smith

CORE

· 3,495 Views · 1 Like

Using AWS Data Lake and S3 With SQL Server: A Detailed Guide With Research Paper Dataset Example

The integration of AWS Data Lake and Amazon S3 with SQL Server provides the ability to store data at any scale and leverage advanced analytics capabilities.

June 7, 2024

by Vijay Panwar

CORE

· 7,481 Views · 1 Like

When Should You Use Distributed PostgreSQL for Gen AI Apps?

In this article, explore when gen AI applications should use distributed PostgreSQL deployments.

June 7, 2024

by Denis Magda

CORE

· 4,413 Views · 1 Like

Comprehensive Guide to Data Analysis and Visualization With Pandas and Matplotlib

Covering data preparation, descriptive statistics, profit margin calculations, and various types of plots such as bar charts, pie charts, and scatter plots.

June 7, 2024

by Krishnamurty Raju Mudunuru

· 7,937 Views · 1 Like

The Role of Data Engineering in Building Scalable AI Systems

Explore the role of data engineering in the field of artificial intelligence, specifically how data engineering influences the success and scalability of AI projects.

June 7, 2024

by Karthik Rajashekaran

CORE

· 3,827 Views · 2 Likes

Getting Started With AI Functions

In this article, I explain how you can get started with AI functions, how they work, and how to include them in your AI chatbot.

June 7, 2024

by Thomas Hansen

CORE

· 2,984 Views · 2 Likes

How To Build a Simple GitHub Action To Deploy a Django Application to the Cloud

In this article, we’ll demonstrate how GitHub Actions and Heroku can be used to quickly deploy a Django application to the cloud.

June 7, 2024

by Michael Bogan

CORE

· 5,735 Views · 2 Likes

Embracing Responsible AI: Principles and Practices

This article provides context on embracing responsible AI along with guidelines for developing AI systems that are transparent, responsible, and lasting.

June 7, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 4,009 Views · 3 Likes

ChatGPT: Your Guide to SQL Query Translation Between Databases

ChatGPT offers a solution for SQL translation by accurately translating queries, handling data types, and suggesting alternatives for proprietary features.

June 7, 2024

by Dmitry Narizhnykh

CORE

· 3,259 Views · 2 Likes

Takeaways From Day 2 of the Snowflake Summit 2024

Snowflake Summit 2024 unveils advancements in AI, data collaboration, and developer tools, empowering enterprises to unlock the full potential of their data.

June 7, 2024

by Tom Smith

CORE

· 3,093 Views · 1 Like

GenAI-Powered Automation and Angular

Learn how GenAI-Powered microservice automation provides a prompt-driven way to create and deliver a complete end-to-end Angular API-enabled application.

June 6, 2024

by Tyler Band

· 7,032 Views · 10 Likes

Machine Learning With Python: Data Preprocessing Techniques

This article will discuss and look at the most popular data preprocessing techniques used for machine learning, and explore methods to clean, transform, and scale data.

June 6, 2024

by Karthik Rajashekaran

CORE

· 10,542 Views · 4 Likes

Building a Tool To Generate Text With OpenAI’s GPT-4 Model

Build a text generation tool using OpenAI's GPT-4. Set up your environment, authenticate the API, make API calls, handle errors, and integrate with Flask for a web app.

June 6, 2024

by Neha Dhaliwal

· 5,147 Views · 4 Likes

The Latest Data Engineering Topics