Make evals handle failures more gracefully

[rtfeldman]

Now when an individual project eval fails, instead of panicking we add it to a list of failures that we collect and report at the end (and make the exit code nonzero).

Release Notes:

• N/A