Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I get frame_tsv/train_32frames.img.lineidx for MSVD? #40

Open
mohammadshahabuddin opened this issue Dec 4, 2022 · 3 comments
Open

Comments

@mohammadshahabuddin
Copy link

Hi,

There is no train_32frames.img.lineidx in the provided codes. How can I get train_32frames.img.tsv, train_128frames_img_size256.img.tsv, test_32frames.img.lineidx,train_32frames.img.lineidx??

What are the difference between train_32frames.img.tsv andtrain_128frames_img_size256.img.tsv?

@mohammadshahabuddin
Copy link
Author

I have solved the lineidx-related issue. The files will be generated during training if generate_lineidx=True is mentioned in this file: src/utils/tsv_file.py

@tiesanguaixia
Copy link

Hi,

There is no train_32frames.img.lineidx in the provided codes. How can I get train_32frames.img.tsv, train_128frames_img_size256.img.tsv, test_32frames.img.lineidx,train_32frames.img.lineidx??

What are the difference between train_32frames.img.tsv andtrain_128frames_img_size256.img.tsv?

Hi! Have you reproduced the results in paper? May I ask did you adjust the value of 'loss_sparse_w' and the 'learning_rate' in command? For the 'loss_sparse_w', I guess it's the regularization hyperparameter of $Loss_{SPARSE}$ , i.e. the $\lambda$ in the paper. In the appendix, it seems like for MSR-VTT, the model performs best when $\lambda$ = 5. But the why the default value of 'loss_sparse_w' in command is 0.5? Do I need to adjust it to 5? Thank you a lot!

@tiesanguaixia
Copy link

generate_lineidx

And how you generate the tsv file by tsv_file.py?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants