Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add GGUF BF16 dtype support #2387

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Add GGUF BF16 dtype support #2387

wants to merge 6 commits into from
+205 −9

Commits on Aug 2, 2024

  1. Add GGUF bf16 type support

    @EricLBuehler
    EricLBuehler committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    5f5d658 View commit details
    Browse the repository at this point in the history

  2. Add non avx impl for vec_dot_bf16

    @EricLBuehler
    EricLBuehler committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    64abbc8 View commit details
    Browse the repository at this point in the history

  3. Fix from_u32

    @EricLBuehler
    EricLBuehler committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    49328fe View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. Merge branch 'dev_main' into gguf_bf16

    @EricLBuehler
    EricLBuehler committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    523b470 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Fix loading

    @EricLBuehler
    EricLBuehler committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    afc85c0 View commit details
    Browse the repository at this point in the history

  2. Fix dequant of bf16

    @EricLBuehler
    EricLBuehler committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    8a874da View commit details
    Browse the repository at this point in the history