Home

Overview The Google App Engine Pipeline API connects together complex, time-consuming workflows (including human tasks). The goals are flexibility, workflow reuse, and testability. A primary use-case of the API is connecting together various App Engine MapReduces into a computational pipeline.

Status This is an early, experimental release of the Pipeline API. Please join the mailing list to ask questions and provide feedback about the API. For now the implementation is only available for Python and Java.

Getting started Read the Getting Started guides for Python and Java to learn about the Pipeline API Read the javadoc Look at the Python Demo and Demo code and the Java Demo and Demo code, which lets you explore the debugging console Check out the library and include it in your project Look at example common Pipelines that are reusable Screenshots The Pipeline library includes a UI for debugging, including:

Status of the pipeline Values of all parameters and returned values Spawned children Status message and links to consoles Loads info on the current top-left-most task every 30 seconds (auto-pilot) Here is an example of a pipeline in-flight with example console:

A Pipeline where all elements have completed