Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compute baselines for test set only #4

Open
dennlinger opened this issue Mar 3, 2022 · 2 comments
Open

Compute baselines for test set only #4

dennlinger opened this issue Mar 3, 2022 · 2 comments

Comments

@dennlinger
Copy link
Owner

The lead baselines in particular (available for the full dataset in the preprint) could be re-computed for the files of the test set only.

Additionally, I recently found sumy, which sounds like more promising baselines.

@dennlinger
Copy link
Owner Author

Currently working on this for validation set (as well). I haven't yet re-computed anything, but due to the smaller data size, this is also desirable for faster iteration.

@dennlinger
Copy link
Owner Author

Finished baselines with current iteration of scripts. However, there is now a large number of files that I don't want to potentially spam the master branch with, so need to think about how to continue here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant