Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Llama 3.2 1B Instruct on TPU v4, bumping transformers to 4.45.2 #109

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Llama 3.2 1B Instruct on TPU v4, bumping transformers to 4.45.2 #109

wants to merge 8 commits into from
+220 −48

Commits on Oct 19, 2024

  1. Installation guide for TPU v4.

    @artus-LYTiQ
    artus-LYTiQ committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    3caeae8 View commit details
    Browse the repository at this point in the history

  2. Forgot pyproject.toml

    @artus-LYTiQ
    artus-LYTiQ committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    446bb2c View commit details
    Browse the repository at this point in the history

  3. Llama 3.2 readiness, current transformer version 

    Note that the two new test are just manual test, not pytests. The rope implementation is unvalidated - we just pray and are happy that it still generates tokens XD
    @artus-LYTiQ
    artus-LYTiQ committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    1ea17d0 View commit details
    Browse the repository at this point in the history

  4. Fix - again forgot a file due to rename

    @artus-LYTiQ
    artus-LYTiQ committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    7210745 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. Changed logging back to debug

    @artus-LYTiQ
    artus-LYTiQ committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    caab98c View commit details
    Browse the repository at this point in the history

  2. removed restore of hf hub from gs bucket

    @artus-LYTiQ
    artus-LYTiQ committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    d7ea97a View commit details
    Browse the repository at this point in the history

  3. change default model for generation, updated logging

    @artus-LYTiQ
    artus-LYTiQ committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    f0237d1 View commit details
    Browse the repository at this point in the history

  4. Changed default models

    @artus-LYTiQ
    artus-LYTiQ committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    1588182 View commit details
    Browse the repository at this point in the history