Data Engineering Resources

Discover how AWS Glue, a serverless data integration service, addresses challenges surrounding unstructured data with custom crawlers and built-in classifiers.

March 27, 2024

by Raghava Dittakavi

CORE

· 2,405 Views · 2 Likes

Data Streaming for AI in the Financial Services Industry (Part 2)

Learn the data streaming strategies to lay a solid foundation for AI, moving from chaos and going into order for data strategies.

March 27, 2024

by Christina Lin

CORE

· 1,235 Views · 1 Like

Strategies for Effective Shard Key Selection in Sharded Database Architectures

Explore strategies for selecting the optimal shard key to ensure balanced data distribution, improved query performance, and scalable growth.

March 27, 2024

by Vijay Panwar

CORE

· 2,064 Views · 1 Like

Kotlin Clean Architecture and CQRS

Explore the implementation of Clean Architecture and CQRS microservice using Kotlin, Spring WebFlux with coroutines, PostgreSQL, MongoDB, and Kafka.

March 27, 2024

by Alexander Bryksin

· 2,364 Views · 2 Likes

Types of Data Breaches in Today’s World

It is vital for organizations to be vigilant in carefully selecting the third parties with whom they allow access to sensitive data.

March 27, 2024

by Saurav Bhattacharya

· 2,727 Views · 3 Likes

S3 Cost Savings

Amazon S3 is a fantastically versatile and scalable storage solution, but keeping costs under control is crucial. This blog post dives into key strategies to lower costs.

March 27, 2024

by Rohit Bordia

· 2,321 Views · 4 Likes

Know How To Get Started With LLMs in 2024

As we move into 2024, Large Language Modeling (LLM) will become an essential and fundamental driver of the generative AI space.

March 27, 2024

by Hiren Dhaduk

· 1,449 Views · 1 Like

The Difficulty of SQL Stems From Relational Algebra

This article explores how the fundamental difficulty of SQL actually stems from its theoretical foundation, namely relational algebra.

March 27, 2024

by Judy Liu

· 1,170 Views · 2 Likes

Artificial Intelligence in Data Visualization: Ethics and Trends for 2024

The integration of immersive technologies into data visualization promises to redefine how we interact with and comprehend complex datasets.

March 27, 2024

by Nishan Singh

· 2,258 Views · 2 Likes

Long Tests: Saving All App’s Debug Logs and Writing Your Own Logs

Approach for software QA to troubleshoot bugs using detailed logging — custom and app's debug logs, using Python and Bash scripts for logging and debugging.

March 27, 2024

by Konstantin Sakhchinskiy

· 14,753 Views · 3 Likes

How To Get Started With New Pattern Matching in Java 21

Dive into pattern matching, a powerful new feature in Java 21 that lets you easily deconstruct and analyze data structures. Follow this tutorial for examples.

March 26, 2024

by Daniel Oh

CORE

· 9,472 Views · 15 Likes

Separation of Tenants in Software Design

This article presents the author's point of view on how to separate data, configuration, and other relevant aspects by showing different approaches and discussing them.

March 26, 2024

by Fabian Lemke

· 1,316 Views · 1 Like

Cloud Computing Security: Ensuring Data Protection in the Digital Age

Cloud computing security is vital for protecting data, demanding robust measures to protect data stored and transmitted through cloud service.

March 26, 2024

by faboye michael

· 2,740 Views · 1 Like

Navigating the Digital Frontier: A Journey Through Information Technology Progress

Embark on a journey through the key milestones and advancements that have shaped the IT landscape, exploring the technologies driving progress and the implications.

March 26, 2024

by Santosh Sahu

· 2,358 Views · 2 Likes

Unlocking IoT Security: Transitioning to Zero-Trust Architecture Simplified

Transitioning to a Zero Trust Architecture (ZTA) for IoT security involves eliminating implicit trust and continuously validating every stage of a digital interaction.

March 26, 2024

by Deep Manishkumar Dave

· 2,144 Views · 2 Likes

Building Ethical AI Starts With the Data Team, Here’s Why

GenAI is an ethical quagmire. What responsibility do data leaders have to navigate it? We consider the need for ethical AI and why data ethics are AI ethics.

March 26, 2024

by Lior Gavish

· 1,417 Views · 1 Like

Automating AWS Infrastructure: Creating API Gateway, NLB, Security Group, and VPC With CloudFormation

In modern cloud environments, Infrastructure as Code (IaC) has become a cornerstone for managing and provisioning resources efficiently

March 26, 2024

by Vijay Panwar

CORE

· 2,272 Views · 2 Likes

Enhancing Secure Software Development With ASOC Platforms

Elevate DevSecOps with AI-powered ASOC platforms for faster, secure software builds. Simplify compliance and enhance security. Explore more in this article.

March 26, 2024

by Alex Vakulov

CORE

· 3,340 Views · 2 Likes

Navigating the AI Renaissance: Practical Insights and Pioneering Use Cases

Taking a look into AI, with real examples and the new use of models like LLaMA, encourages us to imagine a future where AI and human creativity come together.

March 25, 2024

by Rajat Gupta

· 2,120 Views · 5 Likes

Performance Optimization in Agile IoT Cloud Applications: Leveraging Grafana and Similar Tools

Grafana is a vital open-source tool for real-time monitoring, offering customizable dashboards, proactive alerts, and seamless integration for IoT applications.

March 25, 2024

by Deep Manishkumar Dave

· 2,354 Views · 2 Likes

The Latest Data Engineering Topics