Skip to content

Design platform for pipeline development using a set of connected bash commands in a graphml file

License

Notifications You must be signed in to change notification settings

theoportlock/workforce

Repository files navigation

workforce

Documentation Status

Build and run a pipeline of bash commands with python multiprocessing according to a tsv file edgelist.

Installation

Installation can be done with:

pip install workforce

Building a workforce workflow

To launch the pipeline editor, run:

wf

To open a previously constructed pipeline, run:

wf <PIPELINE.graphml>

Running workforce plan

To run a sample plan from workforce github project:

wf run example_plan.graphml

Live viewing workforce plan

To view a plan as it is excecuting:

wf view example_plan.graphml

Note that running and viewing the live plan can be done from the GUI directly.

To run individual process(es) from the editor, select the process(es) in the order that you wish them to be excecuted and click the 'Run' button. The command line from where the builder was launched will display the standard output and error for each process.

Deleting processes or edges on the project can be done by selecting a process and clicking the 'Delete' button

The simplest way to edit a process is to click the edge that the process is connected to. This will fill the 'Input' box with the connection details. You can then add a new node with those connections and delete the old process.

This is tested on mac and linux but work requires work for windows integration except for wsl2

About

Design platform for pipeline development using a set of connected bash commands in a graphml file

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published