We are pleased to announce the release of Spring Cloud Data Flow for Apache YARN 1.0.0.RELEASE.

Spring Cloud Data Flow for Apache YARN provides support for orchestrating long-running (streaming) and short-lived (task/batch) data microservices on Apache YARN.

This project was originally conceptualized with the goal to supplement the existing Spring XD users who have investments running streaming and batch data pipelines in a more traditional bare-metal setup. We wanted to provide migration path to help port over their existing investments and the tools and techniques to reap the benefits of microservices style architecture.

Apart from API cleanups and stabilization, we have worked on the following themes on this major release.

• Builds upon 1.0.0.RELEASE of Spring Cloud Data Flow Core (shell, UI, REST-APIs, etc.)
• Adds scaling infrastructure to support stream partitioning
• Several improvements to Spring Cloud Data Flow’s Amabri plugin
• Adds migration guide and other documentation fragments to the reference documentation
• Adds a project site
• Adds getting-started-guide to bootstrap Spring Cloud Data Flow on HDP 2.4 sandbox

For a complete list of changes and improvements, please refer to 1.0.0.RELEASE server release and 1.0.0.RELEASE deployer release.

The Spring Cloud Data Flow team will be talking at Spring One Platform, which will be taking place in Las Vegas between August 1-4 this year. There are many other great talks so check the agenda and get your ticket if you haven’t done so already.