Data Engineering Resources

On Some Aspects of Big Data Processing in Apache Spark, Part 1: Serialization

In this post, review the basics of how Apache Spark runs its jobs and discover how to avoid serialization errors.

August 11, 2022

by Alexander Eleseev

CORE

· 7,007 Views · 2 Likes

Conceptual Architecture: Conversational AI/NLP-Based Platform

Conceptual Architecture for Conversational Artificial Intelligence (AI) / Natural Language Processing (NLP) based Platform for Customer Support and Agent Services.

August 11, 2022

by Chandra Manohar

· 10,338 Views · 3 Likes

Hide Your API Keys With an API Proxy Server

The main goal of this article/tutorial is to demonstrate how to conceal public API keys by building an API proxy server using NodeJS.

August 11, 2022

by Pantelis Theodosiou

· 5,497 Views · 2 Likes

How Big Data Is Shaping the Future of HR Analytics

Big data in HR enables organizations to make better decisions regarding hiring, firing, and managing their employees.

August 11, 2022

by Ryan Kh

· 4,918 Views · 3 Likes

Azure Databricks Automated Testing Using Great Expectations and C#

This article will show you how to use the Great Expectations library to test data migration and how to automate your tests in Azure Databricks using C# and NUnit.

August 11, 2022

by Mohammed Basil

· 11,390 Views · 3 Likes

A BGP Guide for the Non-Network Engineer

This article focuses on the basics of BGP (Border Gateway Protocol) for the non-network engineer.

August 11, 2022

by Mehdi Daoudi

· 7,089 Views · 1 Like

What Is the Future of Humans With Artificial Intelligence (AI)?

The use of AI can facilitate humankind in reaching its potential. It will contribute to a sustainable future for humans if used within ethical limits.

August 10, 2022

by Emily Daniel

· 5,683 Views · 1 Like

Problems With Kafka Streams: The Saga Continues

Problems with the old version of Kafka haven't been solved completely. Some shortcomings have been fixed while some problems have been introduced. The cycle continues.

Updated August 10, 2022

by Aleksandar Pejakovic

· 17,623 Views · 11 Likes

Delivering the Future of Uber-Like Apps With AI and ML

Uber uses AI and ML for fraud detection, risk assessment, safety processes, marketing, matching drivers and riders, and just about everywhere else it's possible to apply.

Updated August 10, 2022

by Anahit Ghazaryan

· 7,997 Views · 3 Likes

Don’t Shove Your API Data Into Amplitude

Web analytics are different than API analytics. The right platform will aid growth with meaningful metrics. Learn what solution is best for your API product.

August 9, 2022

by Lawrence Ebringer

CORE

· 3,435 Views · 1 Like

Introduction: Querydsl vs. JPA Criteria

This article presents an introduction to the Querydsl series with the goal to highlight the difference from JPA Criteria.

Updated August 9, 2022

by Arnošt Havelka

CORE

· 19,429 Views · 8 Likes

Apache Kafka in Crypto and Finserv for Cybersecurity and Fraud Detection

Data streaming with Apache Kafka in crypto markets + financial services for cybersecurity / fraud detection via real-time threat intelligence

August 9, 2022

by Kai Wähner

CORE

· 4,707 Views · 3 Likes

Snake-Based REST API (Python, Mamba, Hydra, and Fast API)

Using Python, Fast API, Hydra, and Mamba to build dockerized applications.

August 9, 2022

by Bartłomiej Żyliński

CORE

· 8,528 Views · 4 Likes

Introduction to JPA Architecture

Here's everything you need to know about the Java persistence API.

Updated August 9, 2022

by Ramesh Fadatare

· 38,649 Views · 37 Likes

A Guide to Creating an API for Your Mobile App

These best practices for creating an API for your mobile app will help you ensure good performance, security, and design.

Updated August 9, 2022

by Melissa Crooks

· 15,819 Views · 8 Likes

Eclipse's RAP Push Session Revisited

If you're writing code for a web application using Java, read this post to learn about how to work with the newest updates to Eclipse.

Updated August 9, 2022

by Kees Pieters

· 6,322 Views · 2 Likes

Monitoring Blind Spots in the Cloud and What to Do About Them

Discover the 3 primary monitoring blind spots and what you and your team can do to stay aware of ever-hidden performance problems.

August 9, 2022

by Mehdi Daoudi

· 3,513 Views · 1 Like

Massively Scalable Geographic Graph Analytics: InfiniteGraph and Uber’s Hexagonal Hierarchical Spatial Index

In this article, learn how InfiniteGraph was used to build an implementation of the H3 Hexagonal Hierarchical Spatial Index.

August 9, 2022

by Daniel Hall

· 5,430 Views · 1 Like

Difference Between Data Mining and Data Warehousing

When you hear the term "data mining," How about the word "data warehousing"? Find out what exactly is the difference between data mining and data warehousing.

Updated August 9, 2022

by Samuel Darwin

· 5,433 Views · 1 Like

Create a Millisecond-Precision Time Ticks Chart with NodeJS

You'll create an interactive and real-time time ticks chart with NodeJS and LightningChart JS. This chart features an ultra-high precision zoom level up to milliseconds.

August 9, 2022

by LightningChart LightningChart

· 5,977 Views · 2 Likes

The Latest Data Engineering Topics