Skip to content
This repository was archived by the owner on Oct 11, 2025. It is now read-only.

Home

Jump to bottom
tkaitchuck edited this page Oct 22, 2014 · 10 revisions

Overview

The Google App Engine Pipeline API connects together complex, time-consuming workflows (including human tasks). The goals are flexibility, workflow reuse, and testability. A primary use-case of the API is connecting together various App Engine MapReduces into a computational pipeline.

Status

This is opensource and community supported. Please join the mailing list to ask questions. There are implementations is both Python and Java.

Getting started

  • Read the Getting Started guides for Python and Java to learn about the Pipeline API
  • Take a look at the Python or Java examples
  • Look at example common Pipelines that are reusable

Screenshots

The Pipeline library includes a UI for debugging, including:

Status of the pipeline Values of all parameters and returned values Spawned children Status message and links to consoles

Here is an example of a pipeline in-flight with example console:

Status console

A Pipeline where all elements have completed

Completed job

Clone this wiki locally