Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Online weight update [WIP] #2119

Draft
wants to merge 17 commits into
base: main
Choose a base branch
from
Draft

Online weight update [WIP] #2119

wants to merge 17 commits into from

Commits on Nov 18, 2024

  1. update parameters online in model runner

    @zhaochenyang20
    zhaochenyang20 committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    a3a57c2 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. fix the rank config in init_process_group

    @zhaochenyang20
    zhaochenyang20 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    d9c8ca9 View commit details
    Browse the repository at this point in the history

  2. add get_parameter_by_name api for unit test of weight updates online

    @zhaochenyang20
    zhaochenyang20 committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    9944fdb View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2024

  1. test customed process group function

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    eceed0d View commit details
    Browse the repository at this point in the history

  2. revert update weights from disk

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    032d909 View commit details
    Browse the repository at this point in the history

  3. [WIP] deal lock detected in init group for parameters

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    ea6572a View commit details
    Browse the repository at this point in the history

  4. revert srt/utils

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3c155f8 View commit details
    Browse the repository at this point in the history

  5. fix init function name

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    d566b98 View commit details
    Browse the repository at this point in the history

  6. fix deak lock of init process group

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    0045f98 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into online-weight-update

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    7874f39 View commit details
    Browse the repository at this point in the history

  8. Successfully initialized parameter update group between huggingface a… 

    …nd SGLang server.
    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    05cf5a7 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' into online-weight-update

    @zhaochenyang20
    zhaochenyang20 committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3596b01 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2024

  1. [WIP] broadcast error

    @zhaochenyang20
    zhaochenyang20 committed Nov 23, 2024
    Configuration menu
    Copy the full SHA
    779c2a0 View commit details
    Browse the repository at this point in the history

  2. [WIP] device and wolrd size error

    @zhaochenyang20
    zhaochenyang20 committed Nov 23, 2024
    Configuration menu
    Copy the full SHA
    8c8710e View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2024

  1. [WIP] merge router into weight update

    @zhaochenyang20
    zhaochenyang20 committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    88814d4 View commit details
    Browse the repository at this point in the history

  2. [WIP] merge fix docs

    @zhaochenyang20
    zhaochenyang20 committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    f3f87a4 View commit details
    Browse the repository at this point in the history

  3. [WIP] group conflicts

    @zhaochenyang20
    zhaochenyang20 committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    70755d8 View commit details
    Browse the repository at this point in the history