Data Engineering Resources

Integrating Software Supply Chains and DevOps: Tips for Effectively Reconciling Supply Chain Management and DevOps

Enacting visibility, input, and accountability for both the development and operations teams ensures secure SSCs and provides an opportunity to strengthen DevOps culture.

March 3, 2024

by Justin Albano

CORE

· 7,837 Views · 1 Like

Exploring Python Tools for Generative AI

Python, with its vast ecosystem of libraries and frameworks, serves as a powerful platform for exploring the boundless potential of generative AI.

March 1, 2024

by Apurva Kumar

· 4,725 Views · 2 Likes

Extractive Summarization With LLM Using BERT

Extractive summarization is a prominent technique in the field of NLP. Learn how you can pull key sentences out of a corpus of text using BERT Summarization.

March 1, 2024

by Kevin Vu

· 4,367 Views · 1 Like

Evaluating LLMs: Beyond Traditional Software Testing

LLM evaluation is constantly changing as the models improve; LLMs don't have simple right/wrong answers, making results subjective, so testing methods need to adapt.

March 1, 2024

by Ramakrishnan Neelakandan

· 4,404 Views · 3 Likes

Making Cloud Simpler: How Tangoe's AI and Patents Streamline FinOps

Simplify complicated cloud cost management with AI that optimizes usage and spending while freeing up architects and developers.

March 1, 2024

by Tom Smith

CORE

· 4,610 Views · 1 Like

AI Advancement for API and Microservices

AI advancements in API technology involve enhancing NLP capabilities, improving algorithmic decision-making through reinforcement learning, and expanding AI integration.

March 1, 2024

by Nilesh Charankar

· 4,770 Views · 2 Likes

Introduction To Backtesting Strategy: Historical Data Replay in DolphinDB

Import historical data into a stream table in chronological order as “real-time data” so that the same script can be used both for backtesting and real-time trading.

March 1, 2024

by Davis Zhou

· 3,078 Views · 1 Like

Securing and Monitoring Your Data Pipeline: Best Practices for Kafka, AWS RDS, Lambda, and API Gateway Integration

Learn how to implement a data pipeline that integrates Apache Kafka with AWS RDS and use AWS Lambda and API Gateway to feed data into a web application.

February 29, 2024

by Vijay Panwar

CORE

· 5,385 Views · 1 Like

The article introduces the AWS SNS Fanout architecture as a solution for high-speed message distribution and highlights its scalability, reliability, and cost-efficiency.

February 29, 2024

by Satrajit Basu

CORE

· 4,928 Views · 2 Likes

The Evolution of Database Architectures: Navigating Big Data, Cloud, and AI Integration

The article discusses how database architectures have evolved to handle Big Data, Cloud, and AI, covering RDBMS, NoSQL, and cloud-based solutions.

February 29, 2024

by Pankaj Zanke

· 5,440 Views · 4 Likes

Real-Time Communication Protocols: A Developer's Guide With JavaScript

Explore WebSocket for low latency communication, WebRTC for peer-to-peer streaming, and MQTT for IoT while implementing provided JavaScript examples.

February 29, 2024

by Arun Pandey

CORE

· 10,150 Views · 5 Likes

Logging and Monitoring in Microsoft Azure

In this article, we will explore the importance of logging and monitoring in Azure, as well as various options and best practices for logging and monitoring.

February 29, 2024

by Aditya Bhuyan

· 5,433 Views · 1 Like

Swift Predicate: Usage, Composition, and Considerations

Predicate allows developers to filter and evaluate data collections. This article aims to explore the usage, structure, and key considerations of Swift Predicate.

February 29, 2024

by Fatbobman Xu

· 2,713 Views · 1 Like

Machine Learning at the Edge: Enabling AI on IoT Devices

Implementing ML on IoT devices demands efficient software engineering. Optimize models, use hardware accelerators, manage resources, and prioritize security for success.

February 29, 2024

by Deep Manishkumar Dave

· 3,157 Views · 1 Like

Exploring Four Unique Key Generation Strategies in GridGain and Apache Ignite

Creating "autoincrement" fields in a distributed system such as Apache Ignite is difficult. In this piece, we explore four different options and their tradeoffs.

February 29, 2024

by Stephen Darlington

· 2,438 Views · 1 Like