Data Engineering Resources

Why? Big O notation gives abstraction and the opportunity for generalizing. When? Whenever you want to measure one parameter from the changing volume of another. Where? It is best to look at fairly atomic sections of code that make one specific business logic.

November 22, 2022

by Danylo Tolmachov

· 6,759 Views · 6 Likes

Salesforce Functions for Caching Expensive Queries

Caching is a strategy that can help you conserve resources and improve performance. In this article, we will walk through the use of Salesforce Functions to cache expensive queries.

November 22, 2022

by Michael Bogan

CORE

· 5,633 Views · 1 Like

Genjector: Reflection-free Run-Time Dependency Injection framework for Go 1.18+

Although Generics in Go is still a relatively new feature, it supports solutions for the Dependency Injection framework that can be up to 30 times faster than its peers.

November 22, 2022

by Marko Milojevic

· 5,767 Views · 1 Like

How to Filter NSFW Images and Programmatically Blur Them

In this tutorial, we are going to look at how to detect NSFW images using machine learning algorithms and programmatically blur them based on their NSFW score.

November 22, 2022

by Hrishikesh Pathak

· 4,643 Views · 1 Like

Jakarta EE and MicroProfile at EclipseCon Community Day 2022

Some very unique and valuable Jakarta EE and MicroProfile content was presented at EclipseCon Community Day 2022. This post summarizes and shares that content.

Updated November 22, 2022

by Reza Rahman

· 7,897 Views · 2 Likes

What Is the Difference Between Data Compliance and Data Privacy?

When working with user data, both data compliance and data privacy are important. Read more about the differences between data compliance and data privacy.

November 22, 2022

by Derric Gilling

CORE

· 7,001 Views · 3 Likes

Migration from Amazon SQS and Kinesis to Apache Kafka and Flink

DoorDash replaced cloud-native Amazon Kinesis and SQS with Apache Kafka and Flink to provide a simple end-to-end integration pipeline.

November 22, 2022

by Kai Wähner

CORE

· 5,589 Views · 3 Likes

Request Tracing in Spring Cloud Stream Data Pipelines With Kafka Binder

This article explains how to implement request tracing in spring cloud steam data pipelines with Kafka Binder.

November 21, 2022

by Hemanth Atluri

· 4,428 Views · 1 Like

Scaling Continuous Deployment Adoption

In this article, we will use the acronym CD to refer to Continuous Deployment, and most of the points discussed are relevant to Continuous Delivery as well.

November 21, 2022

by Bharath Kasimani

· 8,211 Views · 2 Likes

When To Use the @DynamicUpdate With Spring Data JPA

Explore a few scenarios to use @DynamicUpdate with Spring Data JPA. Different classes of databases are highlighted, including PostgreSQL and YugabyteDB.

November 21, 2022

by Denis Magda

CORE

· 24,791 Views · 9 Likes

An Introduction to Decision Trees for Machine Learning

Modern machine learning algorithms are revolutionizing our daily lives. Today, building complex machine learning algorithms is easier than ever.

November 21, 2022

by Stylianos Kampakis

· 5,644 Views · 1 Like

Posture Recognition: Natural Interaction Brought to Life

Learn how to recognize human postures in your app to implement AR-based interactions.

November 21, 2022

by Jackson Jiang

· 4,859 Views · 1 Like

Understanding Consistency Level in the Milvus Vector Database (Part II)

Examine the mechanism that enables users of the Milvus vector database to choose the ideal consistency level for various application scenarios flexibly.

November 21, 2022

by JiQuan Long

· 6,014 Views · 2 Likes

How Much Automation Is Too Much?

Now that automation has become a primary goal of enterprise IT — in particular, within IT operations — we should ask the question: How much automation is too much?

November 20, 2022

by Jason Bloomberg

· 8,083 Views · 2 Likes

10 GitHub Repositories for AutoML

Automated Machine Learning, more commonly referred to as AutoML, is machine learning made easier. AutoML uses automatic processing done by given frameworks to make machine learning more accessible to non-machine learning experts.

November 19, 2022

by Kevin Vu

· 5,851 Views · 1 Like

The Distributed Data Problem

How to serve your customers’ needs—no matter where they are.

November 19, 2022

by Aaron Ploetz

· 7,443 Views · 2 Likes

How to Use the Bitly API in Ruby

Bitly has an API so that you can shorten, expand and get metrics on links all in your app. This is how to use that Bitly API in Ruby.

November 19, 2022

by Phil Nash

· 8,114 Views · 1 Like

Ten Questions About Staff Plus Engineers When It Comes to Technical Career Development

You can stay technical and strategic for the company at the same time. Know more about Staff Plus and the top ten questions about the topic.

November 19, 2022

by Otavio Santana

CORE

· 8,312 Views · 6 Likes

Write Your Kubernetes Infrastructure as Go Code - Combine CDK8s With AWS CDK

Learn how to write your Kubernetes infrastructure as a Go code.

November 19, 2022

by Abhishek Gupta

CORE

· 23,156 Views · 4 Likes

A Deep Dive Into Distributed Tracing

Dive deep into components of distributed traces, why to use distributed tracing, considerations for implementing, and popular tools in the market today.

November 18, 2022

by Yitaek Hwang

CORE

· 10,972 Views · 5 Likes

The Latest Data Engineering Topics