DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Join us today at 1 PM EST: "3-Step Approach to Comprehensive Runtime Application Security"
Save your seat
  1. DZone
  2. Data Engineering
  3. Data
  4. DataWeave and the Reduce Operator: Part I

DataWeave and the Reduce Operator: Part I

Reduce is a powerful operator that can be used on an array. Specifically, it can be used to process an :array and operate on each of its elements.

Rahul Kumar user avatar by
Rahul Kumar
·
Feb. 25, 17 · Tutorial
Like (2)
Save
Tweet
Share
32.68K Views

Join the DZone community and get the full member experience.

Join For Free

Reduce is a powerful operator that can be used on an array (DataWeave array datatype).

Reduce can be used to process an :array and operate on each of its elements. It performs an aggregation operation on the elements of the array after performing a lambda operation (optional) on each of its element.

It can be used to create a Scalar, A Map or an Array. It can also be used as a substitute for the map operator. The array to object is also possible via the reduce operator. We use the reduce operator to do this kind of transformation, in addition to various other types.

In this series, I will provide examples of how to use the reduce operator effectively.

For the reduce operations, an accumulator should be chosen according to the aggregate result we want to achieve. Also, the aggregation operator — for example, + (Add), ++ (Concat), * (Multiply), etc. — should be chosen as per requirements.

The accumulator can be viewed as the output variable. It contains the output after all the iterations over the array on which reduce is applied. Accumulator should be carefully chosen depending on the type of Output which we want to get. Suppose we want a string as an end result then a string accumulator needs to be taken, if the end result needs to be an array then accumulator should be an Array and so on. Similarly, if the end result needs to be an Object then accumulator should be an Object.

Execute a Simple Arithmetic Sum of a List's Elements 

Let's say the list elements are [10, 20, 30, 40].

  • Expected output: 100 (sum of all elements of the array).

  • Accumulator: 0 (a number zero is chosen for the addition of subsequent elements).

  • Aggregate operation: + (addition).

  • Dataweave code: payload reduce $$ + $.

We can execute a lambda over each element of the array to get a modified element and add it continuously to the accumulator.

Perform a More Complex Arithmetic Operation

Input payload (a list):

[{number : 10, times : 8},{number : 2, times : 5},{number : 7, times : 7},{number : 6, times : 3},{number : 4, times : 7}]

Expected output:  185 (sum of each element resulting from "number" multiplied by "times").

Accumulator: 0 (a number zero is chosen for the addition of subsequent elements).

Aggregate operation: + (addition).

Dataweave code:

payload reduce ((val, acc = 0) -> acc + (val.number * val.times))  

Array to Array Transformation- Modifying a List

Input payload: 

[{"Capital": "New Delhi","Country": "India"}, {"Capital": "Paris","Country": "France"}, {"Capital": "London","Country": "England"}]

Required output:

["India-New Delhi","France-Paris","England-London"] 

Accumulator: [] (an empty array is chosen for addition of subsequent elements resulting from the lambda).

Aggregate operation: + (addition operation to obtain an array of the elements resulting from lambda; this is used to make an array push on the accumulating array using the modified element).

Dataweave code:

payload reduce ((val, acc = []) -> acc + ( (val.Country) ++ "-" ++ val.Capital ))

Note: This can also be done using the map operator.

I hope that this post helps you get started using the reduce operator,

In the next post, I will try to explain and exemplify some scenarios (:array to :object)  using the reduce operator.

Link for Part 2 of this series https://dzone.com/articles/dataweave-effective-use-of-reduce-operator-part-2

Operator (extension) Data structure Element

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Public Cloud-to-Cloud Repatriation Trend
  • A Real-Time Supply Chain Control Tower Powered by Kafka
  • Visual Network Mapping Your K8s Clusters To Assess Performance
  • 2023 Software Testing Trends: A Look Ahead at the Industry's Future

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: