This year, the Apache Software Foundation announced that Apache Beam was established as a new top-level project. A little over two years ago, Google committed its Dataflow SDK to the Apache Software Foundation, which provides a programming model used to express data processing pipelines very easily.
Talend has a long history with the Apache Software Foundation (and already has committers on key enterprise Apache projects such as Apache ActiveMQ, Camel, CXF, Karaf, Syncope, and Falcon) and has been focusing a lot on developer productivity. Given this, as Google announced its proposal for Dataflow to become an Apache Software Foundation incubator project, it became very natural for Talend to join with them to help accelerate development along with a few other companies that share similar interests and core values.
I recently had the pleasure to sit down with two prominent Apache Beam committers, Frances Perry, PMC and Jean-Baptiste Onofre, PMC to talk about where the Apache Beam project is at today, how it’s being used in the real world, and what the future of the project looks like. Listen below to join me on a deep dive into Apache Beam!