Author and visualize multiverse analysis with ease.
Boba has a domain specific language (Boba DSL) for writing multiverse specifications, and a visual analysis interface (Boba Visualizer) for exploring multiverse outcomes. Boba comes with a command line tool to parse your DSL specification and generate universe scripts, execute all scripts with a single command, merges outputs into a table, and invoke the visualizer.
- works with both python and R, and other scripting languages to come
- handles simple parameter substitution as well as complex code flow dependency
- offers interactive visualizations for exploring consequential decisions, uncertainty, model fit, and more
You might download and install the latest version of this software from the Python package index (PyPI):
pip install --upgrade boba pip install --upgrade boba-visualizer
To author your multiverse, please refer to the specification rules. Here is a simple example to get you started!
To parse your specification and generate actual scripts, invoke boba and pass in the path to your template script and your JSON spec:
boba compile --script template.py
To execute the multiverse, namely running all the generated scripts, use:
boba run --all
To start the Boba Visualizer after getting the intermediate output files, use:
boba-server
For more command line options, see CLI. For more information about the Boba Visualizer, see this project.
- A simple example to walk you through the basics
- A more complex example using Steegen's multiverse analysis and Durante's fertility dataset.
- Another multiverse example, based on the specification curve paper by Simonsohn et al.
If you are interested in this work, please see our research paper and consider citing our work:
@misc{liu2020boba,
title={Boba: Authoring and visualizing multiverse analyses},
author={Yang Liu and Alex Kale and Tim Althoff and Jeffrey Heer},
year={2020},
eprint={2007.05551},
archivePrefix={arXiv},
primaryClass={cs.HC}
}