Data Engineering Resources

Java Bean Validation: Applying Constraints Programmatically

Learn how to configure a Java bean validator in order to apply constraints programmatically within a Spring application.

September 24, 2024

by Maksim Kren

· 8,552 Views · 3 Likes

Efficient Transformer Attention for GenAI

Explore this overview of recent research focused on building efficient transformer models by reducing the computational complexity of self-attention.

September 24, 2024

by Anurag Paul

· 4,188 Views · 2 Likes

Practical Generators in Go 1.23 for Database Pagination

Learn techniques that have broad applications across various domains, helping to optimize system resource usage and improve overall application responsiveness.

September 24, 2024

by Nikita Melnikov

· 26,838 Views · 1 Like

What Is a Data Pipeline?

In this post, we examine data pipelines, explore their benefits, compare them to other data processes, and discuss various implementation methods.

Updated September 24, 2024

by Garrett Alley

· 52,901 Views · 18 Likes

Human Introspection With Machine Intelligence

Explore the abductive logic programming (ALP) approach within computational logic and how it can be utilized to enhance our cognitive processes and behaviors.

September 24, 2024

by vuppulapati Chandra Sekhar Naidu

· 2,249 Views · 3 Likes

Supporting Offline Mode: Key Strategies and Benefits for iOS Mobile Apps

Supporting offline mode in mobile apps enhances user experience by enabling use without an internet connection through data caching, synchronization, and more.

September 23, 2024

by Namaswi Chandarana

· 3,922 Views · 1 Like

The Future Speaks: Real-Time AI Voice Agents With Ultra-Low Latency

Open-source AI voice agents now achieve real-time, low-latency responses with under 500ms turnaround time. What will you create with it?

September 23, 2024

by Waqas Saeed

· 4,384 Views · 2 Likes

Reducing Infrastructure Misconfigurations With IaC Security

IaC streamlines cloud management but brings security risks. Improve security with static code analysis and dynamic policy checks to mitigate misconfigurations.

September 23, 2024

by Siri Varma Vegiraju

CORE

· 5,476 Views · 2 Likes

Blue-Green Deployment: Update Your Software Risk Free

Unpack fundamentals of blue-green deployment, explore benefits, dive into practical applications within AWS, and compare with alternative deployment methods.

September 23, 2024

by Egor Kaleynik

· 6,404 Views · 5 Likes

Redefining Artifact Storage: Preparing for Tomorrow's Binary Management Needs

Next-gen artifact storage must be vendor-neutral, scalable, and flexible to avoid lock-in and support future innovation.

September 23, 2024

by Vishal Raina

· 5,194 Views · 2 Likes

Build Vector Embeddings for Video via Python Notebook and OpenAI CLIP

Delve into AI's capabilities to analyze video data and how vector embeddings, created with Python and OpenAI CLIP, can help interpret and analyze video content.

September 23, 2024

by Akmal Chaudhri

CORE

· 3,926 Views · 2 Likes

10 Security Best Practices for SaaS

SaaS security encompasses a range of measures and protocols designed to protect sensitive data and ensure the safety of users within a SaaS environment.

September 23, 2024

by Alfonso Valdes

· 4,681 Views · 6 Likes

Mastering the Art of Data Engineering to Support Billion-Dollar Tech Ecosystems

This article discusses managing the continuously increasing data footprint and efficient ways of data processing using a Massive Parallel Processing database.

September 20, 2024

by Ashish Karalkar

· 5,597 Views · 2 Likes

Decoding LLM Parameters, Part 1: Temperature

The first article in this multi-part series explores how parameter tuning impacts creativity, precision, and diversity in LLM content generation.

September 20, 2024

by Pavan Vemuri

CORE

· 6,691 Views · 9 Likes

Navigating the Regulatory Maze: Simplifying Data Compliance

Explore how IT professionals can address evolving regulatory compliance challenges in data management, reducing organizational risks and costs.

September 20, 2024

by Tom Smith

CORE

· 4,413 Views · 1 Like

Open Source .NET Aspire and Dapr: What Are They and How Do They Complement Each Other For Distributed Apps?

This article covers both .NET Aspire and Dapr, the problems they solve, their differences, and why .NET developers should use them together.

September 20, 2024

by Marc Duiker

· 4,241 Views · 3 Likes

Observability With eBPF

Take an in-depth look at eBPF, a technology that allows you to run sandboxed programs within the Linux kernel.

September 19, 2024

by Kranthi Kiran Erusu

· 10,929 Views · 7 Likes

Battle of the RabbitMQ Queues: Performance Insights on Classic and Quorum

When deciding between RabbitMQ’s Classic and Quorum queues, it’s important to recognize that both have their strengths and weaknesses. Learn more here.

September 19, 2024

by Josephine Eskaline Joyce

CORE

· 19,038 Views · 9 Likes

Predicting Traffic Volume With Artificial Intelligence and Machine Learning

Explore the potential of random forest models in traffic forecasting and insights for future research aimed at improving urban traffic management systems.

September 19, 2024

by Aadi Jewargi

· 5,986 Views · 3 Likes

Enhancing Few-Shot Text Classification With Noisy Channel Language Model Prompting

Explore noisy channel language model prompting: few-shot text classification, enhancing stability, handling imbalanced data, and generalizing to unseen labels.

September 18, 2024

by Nakul Pandey

· 4,363 Views · 1 Like

The Latest Data Engineering Topics