Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

using yardstick (or other package) for performance calculations #495

Open
topepo opened this issue Apr 2, 2022 · 0 comments
Open

using yardstick (or other package) for performance calculations #495

topepo opened this issue Apr 2, 2022 · 0 comments
Labels
R 🐳 Related to R
Milestone

Comments

@topepo
Copy link

topepo commented Apr 2, 2022

The loss functions included are great but are somewhat limited.

There are a lot of R packages that could expand the types of loss functions (but at the loss of R:python parity).

If you were to use yardstick, for example, the benefits would be:

  • More metrics
  • Data on direction (e.g larger-is-better) for each metrics. You wouldn't have to do 1 - AUC anymore.
  • yardstick can compute multiple metrics at once.
  • Numerous multi-class metrics
  • Metrics for censored regression
  • Extensible for user-defined metrics

The downside to the current system is that you might optimize your model on a set of performance scores and judge feature importance on some other score.

Let use know if we can help or put in a PR.

@pbiecek pbiecek added the R 🐳 Related to R label May 5, 2022
@pbiecek pbiecek added this to the DALEX v3.0.0 milestone May 5, 2022
pbiecek added a commit that referenced this issue May 20, 2022
pbiecek added a commit that referenced this issue May 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
R 🐳 Related to R
Projects
None yet
Development

No branches or pull requests

2 participants