Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix Gemma-2 multiple eos/bos ids #87

Merged
merged 15 commits into from
Aug 22, 2024
Merged

Fix Gemma-2 multiple eos/bos ids #87

merged 15 commits into from
Aug 22, 2024

Commits on Aug 13, 2024

  1. Support in-situ quantization

    @guoqingbao
    guoqingbao committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    899515a View commit details
    Browse the repository at this point in the history

  2. Typo fix

    @guoqingbao
    guoqingbao committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    6e791f5 View commit details
    Browse the repository at this point in the history

  3. Cargo fmt

    @guoqingbao
    guoqingbao committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    504398d View commit details
    Browse the repository at this point in the history

  4. Optimize quantized matmul in batch processing & update Q4K results

    @guoqingbao
    guoqingbao committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    a3e1fc4 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into develop

    @guoqingbao
    guoqingbao authored Aug 13, 2024
    Configuration menu
    Copy the full SHA
    7309f55 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Fix bug for non-stream response

    @guoqingbao
    guoqingbao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    80f56ae View commit details
    Browse the repository at this point in the history

  2. Ask users to provide huggingface token if no token cached and passed … 

    …to the program.
    @guoqingbao
    guoqingbao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    bd476d3 View commit details
    Browse the repository at this point in the history

  3. No crash when both hidden_act and hidden_activation are set for gemma… 

    … model
    @guoqingbao
    guoqingbao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    afb50f3 View commit details
    Browse the repository at this point in the history

  4. Print the number of decoded tokens for each request

    @guoqingbao
    guoqingbao committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    616ffc6 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Merge branch 'master' into develop

    @guoqingbao
    guoqingbao committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    573a61a View commit details
    Browse the repository at this point in the history

  2. Restore previous bug fix

    @guoqingbao
    guoqingbao committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    360a227 View commit details
    Browse the repository at this point in the history

  3. Support softcapping (Gemma-2 models)

    @guoqingbao
    guoqingbao committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    a33884f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into develop

    @guoqingbao
    guoqingbao authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    f3b1a7d View commit details
    Browse the repository at this point in the history

  5. Update lib.rs

    @guoqingbao
    guoqingbao authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    761067e View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Fix Gemma-2 multiple eos/bos ids

    @guoqingbao
    guoqingbao committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    ff84499 View commit details
    Browse the repository at this point in the history