Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Same y-range of non-paired bootstrap graphs #26

Open
martinpopel opened this issue Jul 22, 2015 · 0 comments
Open

Same y-range of non-paired bootstrap graphs #26

martinpopel opened this issue Jul 22, 2015 · 0 comments

Comments

@martinpopel
Copy link
Collaborator

See e.g. the Statistics tab of
http://quest.ms.mff.cuni.cz:7280/tasks/228-229/compare

On the first sight, the two bottom (non-paired) Bootstrap Resampling graphs of commercial1 and CU-Chimera look almost the same. However, the y-axis is different and the two confidence intervals are non-overlapping, because commercial1 is much worse than CU-Chimera.

Suggestion1

Keep the y-axis scale the same for both graphs.

Suggestion2

Merge the two graphs into one. Don't fill the area under curves, only make the yellow and blue curves thicker.
Change also the title:

(Non-paired) Bootstrap Resampling: BLEU-cis
commercial1: 95% confidence interval [0.0904, 0.0993]
CU-Chimera: 95% confidence interval [0.1929, 0.2059]

Suggestion3

After Suggestion2, there will be a free space.
We can use this space for (non-paired) sentence-level BLEU curves.
So there will be again two curves (blue and yellow) in one graph, the two curves will be non-decreasing (the sentence-level BLEU scores will be sorted, independently for each system).
This suggestion is a feature request, not really related to this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant