Python: Equivalent to flatMap for Flattening an Array of Arrays
Join the DZone community and get the full member experience.
Join For FreeI found myself wanting to flatten an array of arrays while writing some Python code earlier this afternoon and being lazy my first attempt involved building the flattened array manually:
episodes = [
{"id": 1, "topics": [1,2,3]},
{"id": 2, "topics": [4,5,6]}
]
flattened_episodes = []
for episode in episodes:
for topic in episode["topics"]:
flattened_episodes.append({"id": episode["id"], "topic": topic})
for episode in flattened_episodes:
print episodeIf we run that we’ll see this output:
$ python flatten.py
{'topic': 1, 'id': 1}
{'topic': 2, 'id': 1}
{'topic': 3, 'id': 1}
{'topic': 4, 'id': 2}
{'topic': 5, 'id': 2}
{'topic': 6, 'id': 2}What I was really looking for was the Python equivalent to the flatmap function which I learnt can be achieved in Python with a list comprehension like so:
flattened_episodes = [{"id": episode["id"], "topic": topic}
for episode in episodes
for topic in episode["topics"]]
for episode in flattened_episodes:
print episodeWe could also choose to use itertools in which case we’d have the following code:
from itertools import chain, imap
flattened_episodes = chain.from_iterable(
imap(lambda episode: [{"id": episode["id"], "topic": topic}
for topic in episode["topics"]],
episodes))
for episode in flattened_episodes:
print episodeWe can then simplify this approach a little by wrapping it up in a ‘flatmap’ function:
def flatmap(f, items):
return chain.from_iterable(imap(f, items))
flattened_episodes = flatmap(
lambda episode: [{"id": episode["id"], "topic": topic} for topic in episode["topics"]], episodes)
for episode in flattened_episodes:
print episodeI think the list comprehensions approach still works but I need to look into itertools more – it looks like it could work well for other list operations.
Published at DZone with permission of Mark Needham. See the original article here.
Opinions expressed by DZone contributors are their own.
Comments