Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

预训练dataset和tokenized path #6335

Closed
1 task done
nuochenpku opened this issue Dec 15, 2024 · 3 comments
Closed
1 task done

预训练dataset和tokenized path #6335

nuochenpku opened this issue Dec 15, 2024 · 3 comments
Labels
solved This problem has been already solved

Comments

@nuochenpku
Copy link

Reminder

  • I have read the README and searched the existing issues.

System Info

如果我设置了tokenized path,是否还需要设置dataset?
额外我加入了eval,如果不加dataset,则会报错:
File "/mnt/nas/nuochen/code/cpt/LLaMA-Factory/src/llamafactory/hparams/data_args.py", line 140, in post_init
raise ValueError("Cannot specify val_size if dataset is None.")
ValueError: Cannot specify val_size if dataset is None.

Reproduction

FORCE_TORCHRUN=1 NNODES=2 NODE_RANK=${RANK} MASTER_ADDR=192.168.0.1 MASTER_PORT=29500 llamafactory-cli train examples/train_full/llama3_full_cpt.yaml

Expected behavior

No response

Others

No response

@github-actions github-actions bot added the pending This problem is yet to be addressed label Dec 15, 2024
@hiyouga
Copy link
Owner

hiyouga commented Dec 15, 2024

仍然需要设置 dataset 参数

@hiyouga hiyouga closed this as completed Dec 15, 2024
@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels Dec 15, 2024
@nuochenpku
Copy link
Author

那么dataset与tokenized path设置为一样的路径?

@hiyouga
Copy link
Owner

hiyouga commented Dec 17, 2024

dataset 随便写就行,但是不能为空

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

No branches or pull requests

2 participants