Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataloader for UCF-CC-50 #22

Open
jingliang95 opened this issue Apr 30, 2021 · 4 comments
Open

Dataloader for UCF-CC-50 #22

jingliang95 opened this issue Apr 30, 2021 · 4 comments

Comments

@jingliang95
Copy link

This is a very great work. Thanks a lot

Could you also share the dataloader and experimental setting (like crop size and so on) for dataset UCF-CC-50? Currently, I am working on this dataset, but I have trouble obtaining the results you reported. I think it may due to the dataloader or other experimental setting.

@jingliang95
Copy link
Author

Specifically, I use UCF-CC-50 and do 5-fold cross validation. The crop size is 512 and I got average performance of 280.53 (MAE) and 419.0 (MSE), which is much worse than the reported number of 211.0 and 291.5. I think there must be something I missed. Could you help me with that? Thanks a lot

@Boyu-Wang
Copy link
Collaborator

The dataloader for UCF-CC-50 is the same as the dataloader for ShanghaiTech.
The crop size is 256.
Due to the limited number of images (50), the performance on UCF-CC-50 is less robust and may not reflect the true performance of the method. Even different ways of splitting affect the performance.
Those large-scale datasets (e.g. ShTech, QNRF, NWPU, JHU) are better benchmarks for evaluation.

@gabridego
Copy link

Hello @Boyu-Wang , is a model pretrained on JHU available ?

@lijinStudy
Copy link

The dataloader for UCF-CC-50 is the same as the dataloader for ShanghaiTech. The crop size is 256. Due to the limited number of images (50), the performance on UCF-CC-50 is less robust and may not reflect the true performance of the method. Even different ways of splitting affect the performance. Those large-scale datasets (e.g. ShTech, QNRF, NWPU, JHU) are better benchmarks for evaluation.

Hello, @Boyu-Wang, Could you share the dataloader for JHU dataset? Thanks!!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants