How to use FP8 for SYCL building? #11527
Unanswered
GermanAizek
asked this question in
Q&A
Replies: 1 comment
-
|
As far as I can see no backends in llama.cpp support fp8. See this related discussion: #8780 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there FP8 support at the moment, documentation only mentions FP16.
Beta Was this translation helpful? Give feedback.
All reactions