Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Great work. quick question on roadmap ETA? #2

Open
darkman111a opened this issue Oct 26, 2023 · 4 comments
Open

Great work. quick question on roadmap ETA? #2

darkman111a opened this issue Oct 26, 2023 · 4 comments

Comments

@darkman111a
Copy link

Just wondering when you were planning on implementing BitLinear layer to use 1-bit weights and custom cuda kernel for 1-bit weight? super thirsty for the code ha. Appreciate you.
@Beomi
Copy link
Owner

Beomi commented Oct 27, 2023

Currently I'm investigating on it. plan to make it compatible with Bitsandbytes.
Since I'm not familiar with CUDA or C++, it'll takes some time,
so currently I could not guarantee the ETA. 😂

@DewEfresh
Copy link

DewEfresh commented Oct 27, 2023 •
edited
Loading

you may want to check out https://github.com/IST-DASLab/qmoe. They created some custom cuda functions for sub 1-bit weights.

@Beomi
Copy link
Owner

Beomi commented Oct 27, 2023

you way want to check out https://github.com/IST-DASLab/qmoe. They created some custom cuda functions for sub 1-bit weights.

Thanks for information!
I'm looking on it 😉

@darkman111a
Copy link
Author

darkman111a commented Oct 28, 2023 •
edited
Loading

Appreciate you. Stay Blessed! This might assist you as well -> https://github.com/brycexu/BNN_Kernel

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Beomi @darkman111a @DewEfresh