Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support constrained decoding #1038

Draft
wants to merge 33 commits into
base: main
Choose a base branch
from
Draft

Support constrained decoding #1038

wants to merge 33 commits into from
+548 −10

Commits on Oct 31, 2024

  1. add llguidance based logits processor

    @Taka152
    Taka152 committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    bf38535 View commit details
    Browse the repository at this point in the history

  2. add unit test

    @Taka152
    Taka152 committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    c151d52 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. constrained decoding fixes (#1023) 

    @Taka152
    @mmoskal
    mmoskal authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    9d5a8a0 View commit details
    Browse the repository at this point in the history

  2. add test grammars

    @Taka152
    Taka152 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    48c3e96 View commit details
    Browse the repository at this point in the history

  3. support cuda

    @Taka152
    Taka152 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    d70b849 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. use tokenize.json to generate token_bytes

    @Taka152
    Taka152 committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    6b90c1c View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. fix win build

    @Taka152
    Taka152 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    bdb9ca4 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. async compute mask

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    a25de8e View commit details
    Browse the repository at this point in the history

  2. add llguidance build in cmake

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    edc0bae View commit details
    Browse the repository at this point in the history

  3. update windows build

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    09861d7 View commit details
    Browse the repository at this point in the history

  4. clean cmake

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    ee94df8 View commit details
    Browse the repository at this point in the history

  5. add install rust to GHA

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4d077cf View commit details
    Browse the repository at this point in the history

  6. test action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    15b20b8 View commit details
    Browse the repository at this point in the history

  7. test win cpu build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    6029510 View commit details
    Browse the repository at this point in the history

  8. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4d8d8a6 View commit details
    Browse the repository at this point in the history

  9. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    346f88c View commit details
    Browse the repository at this point in the history

  10. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    c00d8fa View commit details
    Browse the repository at this point in the history

  11. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    39fb7ed View commit details
    Browse the repository at this point in the history

  12. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    8038723 View commit details
    Browse the repository at this point in the history

  13. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    324f550 View commit details
    Browse the repository at this point in the history

  14. update win build action

    @Taka152
    Taka152 committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    8722727 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. add rust install to workflows

    @Taka152
    Taka152 committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    d620422 View commit details
    Browse the repository at this point in the history

  2. support batch infer

    @Taka152
    Taka152 committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    c1ede01 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. add corrosion to deps.txt

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    d2f47e2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into yingxiong/constrained_decoding

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    8deba60 View commit details
    Browse the repository at this point in the history

  3. fix merge

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    b256e6d View commit details
    Browse the repository at this point in the history

  4. fix bugs

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    e5d6dad View commit details
    Browse the repository at this point in the history

  5. update linux gpu workflow

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    2fd52d2 View commit details
    Browse the repository at this point in the history

  6. update linux gpu workfow

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    a11684b View commit details
    Browse the repository at this point in the history

  7. update linux gpu workflow

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    56663c0 View commit details
    Browse the repository at this point in the history

  8. update workflow

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    8997064 View commit details
    Browse the repository at this point in the history

  9. update workflow

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    ddda727 View commit details
    Browse the repository at this point in the history

  10. update workflows

    @Taka152
    Taka152 committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    cb55778 View commit details
    Browse the repository at this point in the history