Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RewardTrainer] Tokenize inputs within trainer #2102

Merged
merged 15 commits into from
Sep 24, 2024
Merged

[RewardTrainer] Tokenize inputs within trainer #2102

merged 15 commits into from
Sep 24, 2024

Commits on Sep 23, 2024

  1. Pretokenize in reward modelling

    @lewtun
    lewtun committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    8f1d7ee View commit details
    Browse the repository at this point in the history

  2. Fix README example

    @lewtun
    lewtun committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    9c3d1cb View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review 

    Co-authored-by: Quentin Gallouédec <[email protected]>
    @lewtun @qgallouedec
    lewtun and qgallouedec authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    fc9a2f9 View commit details
    Browse the repository at this point in the history

  4. Move chat template formatting inside trainer

    @lewtun
    lewtun committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    13b5ed0 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Refactor tests

    @lewtun
    lewtun committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    9283523 View commit details
    Browse the repository at this point in the history

  2. Fix README

    @lewtun
    lewtun committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    e928e5f View commit details
    Browse the repository at this point in the history

  3. Disable wandb

    @lewtun
    lewtun committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    1f25076 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into rm-refactor

    @lewtun
    lewtun authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    1507ef3 View commit details
    Browse the repository at this point in the history

  5. Update readme

    @qgallouedec
    qgallouedec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    4c0cc42 View commit details
    Browse the repository at this point in the history

  6. add comment remove_unused_columns

    @qgallouedec
    qgallouedec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    e7ec9aa View commit details
    Browse the repository at this point in the history

  7. Update trl/trainer/reward_config.py

    @qgallouedec
    qgallouedec authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    2fa191f View commit details
    Browse the repository at this point in the history

  8. doc

    @qgallouedec
    qgallouedec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    636ea3f View commit details
    Browse the repository at this point in the history

  9. Merge branch 'rm-refactor' of https://github.com/huggingface/trl into… 

    … rm-refactor
    @qgallouedec
    qgallouedec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    0b57d41 View commit details
    Browse the repository at this point in the history

  10. implicit*

    @qgallouedec
    qgallouedec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    cb854f5 View commit details
    Browse the repository at this point in the history

  11. explicit

    @qgallouedec
    qgallouedec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    831a991 View commit details
    Browse the repository at this point in the history