Replies: 1 comment
-
|
yeah makes sense, thanks for the feedback, also sorry I just saw this, it's probably better to open an issue instead |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
During trying quick start guide, I find:
uv pip install --prefix ~/.local torchao fbgemm-gpu-genai --index-url https://download.pytorch.org/whl/nightly/cu130I recommend to avoid extra dependence (fbgemm) in quick start guide, at least to quickly let new user have something which can run.
Looks like only PLAIN and PRESHUFFLED of Int4PackingFormat use fbgemm. perhaps can change other format.
Beta Was this translation helpful? Give feedback.
All reactions