graphviper.graph_tools.generate_dask_workflow

Functions

generate_dask_workflow(viper_graph)

Build the Dask graph (dask.delayed objects) for a viper map/reduce graph.

Module Contents

generate_dask_workflow(viper_graph)[source]

Build the Dask graph (dask.delayed objects) for a viper map/reduce graph.

Parameters:

viper_graph (dict) – The graph description produced by graphviper.graph_tools.map.map() (and optionally graphviper.graph_tools.reduce.reduce()).

Returns:

The list of dask.delayed map nodes, or a single reduced node when a reduce stage is present.

Return type:

list or dask.delayed