Data Engineering Resources

The premise that the code that runs inside your infrastructure can be trusted is dangerous - on-premise or in the Cloud. Here are some arguments that support this claim.

January 20, 2022

by Nicolas Fränkel

· 4,471 Views · 4 Likes

Query Substitution

What to do when an application uses a bad query, and you can't change the application.

January 20, 2022

by Max Tardiveau

· 4,366 Views · 6 Likes

Microservices: Good for Developers' Mental Health

Microservices boost the most important but hard-to-measure metric: Developer Confidence. High confidence fuels good mental health, which can have dramatic benefits in the new workplace.

January 20, 2022

by Simone Pezzano

· 4,948 Views · 3 Likes

Leetcode: Improving String Performance in Swift

Get the most out of your Swift strings when using Leetcode.

January 19, 2022

by Pavel Plotnikov

· 3,749 Views · 13 Likes

Develop XR With Oracle Cloud, Database on HoloLens, Ep 1: Spatial, AI/ML, Kubernetes, and OpenTelemetry

This is the first piece in a series on developing XR applications and experiences using Oracle. Here, explore Spatial, AI/ML, Kubernetes, and OpenTelemetry.

January 19, 2022

by Paul Parkinson

· 21,465 Views · 5 Likes

Coalesce With Care

In Spark, there are two common transformations to change the number of tasks; coalesce and repartition. They are very similar but not identical. Let's see how.

January 19, 2022

by Avi Yehuda

· 4,530 Views · 3 Likes

How To Use SingleStore Pipelines With Kafka, Part 3 of 3

This series of articles looks at the SingleStore feature called Pipelines. Today, learn how to replace the Consumer part of a Producer-Consumer with a SingleStore Pipeline.

January 19, 2022

by Akmal Chaudhri

CORE

· 4,136 Views · 4 Likes

Open-Source SPL That Can Execute SQL Without RDB

There is no RDB in many scenarios, such as encountering CSV/RESTful JSON /MongoDB and other data sources, or performing mixed calculations between these data sources.

January 19, 2022

by Jerry Zhang

· 5,619 Views · 4 Likes

How Does Fabric Solve the Challenges of Data Silos?

One of the major issues solved by fabric is the uncertain volume of incoming data from multiple sources in silos. Read more about the benefits in this post.

January 19, 2022

by Ian Tick

· 4,989 Views · 3 Likes

Infracost: How to Get Started

Infracost is proving to be a timely solution for companies in relation to the cost-determination dilemma when deploying new resources. Here's how to start.

January 18, 2022

by Florian Pialoux

· 4,783 Views · 2 Likes

An Introduction to Adversarial Machine Learning

Adversarial machine learning is concerned with the design of machine learning (ML) algorithms that can resist various security challenges and attackers.

January 18, 2022

by Miguel Hernandez

· 3,528 Views · 5 Likes

Data Integrity: A Data-Driven Organization's Biggest Concern

Although many organizations have implemented a system for data collection and analysis, it's crucial that they can also maintain the integrity of their data.

January 18, 2022

by Zara Ziad

· 3,228 Views · 3 Likes

AWS Lambda Versions and Aliases Explained By Example

Learn how to use AWS Lambda versions and aliases by means of a Java example. Create a simple AWS Java Lambda, create versions and use aliases for your environment.

January 18, 2022

by Gunter Rotsaert

CORE

· 5,637 Views · 6 Likes

Solving Four Kubernetes Networking Challenges

Deploying across multiple clouds, maintaining multiple environments, and ensuring reliable and scalable network policies; we’ll look at how to tackle those challenges.

January 18, 2022

by Michael Bogan

CORE

· 132,980 Views · 6 Likes

How To Create Application Systems In Moments

Previously, creating application systems was time-consuming and complex. Today, you can create them with a single command. Let's see how.

January 18, 2022

by Val Huber

CORE

· 5,635 Views · 5 Likes

Service Discovery From Within the Kubernetes Cluster

Does Java Kubernetes Client live up to the promise of being a Java library to operate the Kubernetes cluster by accessing Kubernetes API? Find out here.

January 17, 2022

by Jan-Rudolph Bührmann

· 7,118 Views · 4 Likes

Database Integration in WSO2 EI 7.1.0

This article demonstrates how we can integrate with databases and do data manipulation in WSO2 EI 7.1.0.

January 17, 2022

by Suman Mohan

· 4,853 Views · 3 Likes

Querying SQL Databases With PySpark

In this article, we'll learn about how to combine Postgres, PySpark, and Arctype to create powerful visualizations and queries on large data sets.

January 17, 2022

by Everett Berry

· 4,742 Views · 2 Likes

Sample Architecture Using Amazon AWS, Microsoft Azure, Google GCP, MongoDB, and Couchbase

In this article, I explore how we can architect an example using products and components from Amazon AWS, Microsoft Azure, Google GCP, MongoDB, and Couchbase.

January 17, 2022

by Keshav Murthy

CORE

· 4,013 Views · 4 Likes

10 Rules for Better Cloud Security

Cloud security is a shared responsibility and a big challenge. Here are the basic rules to have in mind to set up efficient guardrails.

January 17, 2022

by Thomas Segura

· 6,529 Views · 3 Likes

The Latest Data Engineering Topics