Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sparseGPT tool #1

Open
YixinSong-e opened this issue Mar 19, 2023 · 5 comments
Open

sparseGPT tool #1

YixinSong-e opened this issue Mar 19, 2023 · 5 comments

Comments

@YixinSong-e
Copy link

When will the tool be ready for use?
@Ayushk4
Copy link
Member

Ayushk4 commented Mar 19, 2023

I don't have an exact date which I can offer you.

As of now quantization with sparsification is not supported
I would appreciate if you could run it and compare results with the paper.

@YixinSong-e
Copy link
Author

Thanks for your reply, I am very interested in your work and I am looking forward to the completion of the sparsification + quantization function. And I will try sparsification! :)

@YixinSong-e
Copy link
Author

Can I test the model of rwkv in repo now?

@Ayushk4
Copy link
Member

Ayushk4 commented Mar 20, 2023

OPT is nearly completed - I just haven't tested it against results.

RWKV is not ready

@Ayushk4
Copy link
Member

Ayushk4 commented Mar 23, 2023

https://github.com/IST-DASLab/sparsegpt
The authors have released their codebase.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Ayushk4 @YixinSong-e