Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Faster kernels for quantized matmul on cuda #2060

Merged
merged 7 commits into from
Apr 15, 2024
Merged

Faster kernels for quantized matmul on cuda #2060

merged 7 commits into from
Apr 15, 2024

Commits on Apr 14, 2024

  1. Hook the quantized matmul cuda kernels.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    f2dae85 View commit details
    Browse the repository at this point in the history

  2. Add a (currently broken) test.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    28d6b4b View commit details
    Browse the repository at this point in the history

  3. Kernel fixes.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    b23eed8 View commit details
    Browse the repository at this point in the history

  4. Fix by transposing the rhs matrix.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    c81ad77 View commit details
    Browse the repository at this point in the history

  5. Add the q4-1 kernels.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    4c387a7 View commit details
    Browse the repository at this point in the history

  6. Proper block sizes.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    7a70207 View commit details
    Browse the repository at this point in the history

  7. More details in the tests.

    @LaurentMazare
    LaurentMazare committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    e609c07 View commit details
    Browse the repository at this point in the history