You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The best method says it 'Returns a model initialised with the hyper-parameters that perform optimally on average across folds for a given metric.'.
In some cases for a given fairness metric the maximum value indicates poor performance of a metric, as such calling best for certain measures returns the worst performing model, because I believe the best call returns the max value in the mean_storage?
Could an argument to somehow specify what constitutes best for the given measure be added?
Thanks, and let me know if I am just plain wrong.
The text was updated successfully, but these errors were encountered:
GeeseAndQuack
changed the title
Clarification for the cv_results best method
Cv_results best method
May 5, 2022
Hi,
The best method says it 'Returns a model initialised with the hyper-parameters that perform optimally on average across folds for a given metric.'.
In some cases for a given fairness metric the maximum value indicates poor performance of a metric, as such calling best for certain measures returns the worst performing model, because I believe the best call returns the max value in the mean_storage?
Could an argument to somehow specify what constitutes best for the given measure be added?
Thanks, and let me know if I am just plain wrong.
The text was updated successfully, but these errors were encountered: