If we could have docker based test of the plugins for basic functionality that would super.
###Strawman Implementation.
spin up a container for each supported platform, and test run a set of plugin tests to ensure plugins load and there are no segfaults or shared lib oddness.