Data Engineering Resources

Using Azure DevOps Pipeline With Gopaddle for No-Code Kubernetes Deployments

Simplify the process of building automated pipelines for Azure workloads using gopaddle, a no-code platform for Kubernetes deployments across multi-clouds.

January 21, 2022

by Vinothini Raju

· 5,950 Views · 2 Likes

Optimization Techniques Using Java Streams

In this post, we'll focus on how to handle the post-processing of the data using Java Streams. We'll also see very powerful techniques to optimize and order the results.

Updated January 21, 2022

by Manu Barriola

· 14,503 Views · 10 Likes

Software Testing Trends to Win in 2022

Take a look at the drivers in IT organizations that are contributing to the changing landscape and how the software testing landscape is shaping up in 2022

January 20, 2022

by Rahul Pandey

· 4,667 Views · 4 Likes

Exploring CockroachDB With Flyway Schema Migration Tool

Get familiar with Flyway and some of the new capabilities in CockroachDB leveraging schema migrations using a docker-compose environment.

January 20, 2022

by Artem Ervits

CORE

· 2,926 Views · 4 Likes

Exploring CockroachDB with ipython-sql and Jupyter Notebook

Here's how ipython-sql can be leveraged in querying CockroachDB.

January 20, 2022

by Artem Ervits

CORE

· 2,197 Views · 4 Likes

How I Built My Own Stock Index Tracker With Time-Series Data Using Low Code

Step by step tutorial around how to create a stock index tracker with time-series charts using an open-source low-code framework, financial APIs, and Google sheets.

January 20, 2022

by Vihar Kurama

· 4,182 Views · 4 Likes

DataWeave Interview Question: Reverse an Array After Combining Its Elements

This article will help you practice your DataWeave skills in MuleSoft. Use the article as a tutorial for learning more about DataWeave.

January 20, 2022

by Gaurav Dubey

· 6,821 Views · 3 Likes

You're Running Untrusted Code!

The premise that the code that runs inside your infrastructure can be trusted is dangerous - on-premise or in the Cloud. Here are some arguments that support this claim.

January 20, 2022

by Nicolas Fränkel

· 4,403 Views · 4 Likes

Query Substitution

What to do when an application uses a bad query, and you can't change the application.

January 20, 2022

by Max Tardiveau

· 4,240 Views · 6 Likes

Microservices: Good for Developers' Mental Health

Microservices boost the most important but hard-to-measure metric: Developer Confidence. High confidence fuels good mental health, which can have dramatic benefits in the new workplace.

January 20, 2022

by Simone Pezzano

· 4,644 Views · 3 Likes

Leetcode: Improving String Performance in Swift

Get the most out of your Swift strings when using Leetcode.

January 19, 2022

by Pavel Plotnikov

· 3,564 Views · 13 Likes

Develop XR With Oracle Cloud, Database on HoloLens, Ep 1: Spatial, AI/ML, Kubernetes, and OpenTelemetry

This is the first piece in a series on developing XR applications and experiences using Oracle. Here, explore Spatial, AI/ML, Kubernetes, and OpenTelemetry.

January 19, 2022

by Paul Parkinson

· 21,297 Views · 5 Likes

Coalesce With Care

In Spark, there are two common transformations to change the number of tasks; coalesce and repartition. They are very similar but not identical. Let's see how.

January 19, 2022

by Avi Yehuda

· 4,233 Views · 3 Likes

How To Use SingleStore Pipelines With Kafka, Part 3 of 3

This series of articles looks at the SingleStore feature called Pipelines. Today, learn how to replace the Consumer part of a Producer-Consumer with a SingleStore Pipeline.

January 19, 2022

by Akmal Chaudhri

CORE

· 4,056 Views · 4 Likes

Open-Source SPL That Can Execute SQL Without RDB

There is no RDB in many scenarios, such as encountering CSV/RESTful JSON /MongoDB and other data sources, or performing mixed calculations between these data sources.

January 19, 2022

by Jerry Zhang

· 5,453 Views · 4 Likes

How Does Fabric Solve the Challenges of Data Silos?

One of the major issues solved by fabric is the uncertain volume of incoming data from multiple sources in silos. Read more about the benefits in this post.

January 19, 2022

by Ian Tick

· 4,854 Views · 3 Likes

Infracost: How to Get Started

Infracost is proving to be a timely solution for companies in relation to the cost-determination dilemma when deploying new resources. Here's how to start.

January 18, 2022

by Florian Pialoux

· 4,688 Views · 2 Likes

An Introduction to Adversarial Machine Learning

Adversarial machine learning is concerned with the design of machine learning (ML) algorithms that can resist various security challenges and attackers.

January 18, 2022

by Miguel Hernandez

· 3,468 Views · 5 Likes

Data Integrity: A Data-Driven Organization's Biggest Concern

Although many organizations have implemented a system for data collection and analysis, it's crucial that they can also maintain the integrity of their data.

January 18, 2022

by Zara Ziad

· 3,173 Views · 3 Likes

AWS Lambda Versions and Aliases Explained By Example

Learn how to use AWS Lambda versions and aliases by means of a Java example. Create a simple AWS Java Lambda, create versions and use aliases for your environment.

January 18, 2022

by Gunter Rotsaert

CORE

· 5,495 Views · 6 Likes

The Latest Data Engineering Topics