-
Notifications
You must be signed in to change notification settings - Fork 540
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
client.sentence_similarity() does not use correct route by default #2494
Labels
bug
Something isn't working
Comments
(could maybe be useful to double check all the TEI routes (Swagger here) and related client methods to make sure that they work correctly) |
Thanks for reporting these with a reproducible example @MoritzLaurer. I'm figuring out a solution to avoid this kind of problems where we don't call the correct endpoint because of difference between Inference API and Inference Endpoints (similar to #2484). Will keep you posted. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
I have a TEI embedding model endpoint created like this:
Based on the docs here, I should be able to call it like this:
This results in this (hard to interpret) error message:
HfHubHTTPError: 422 Client Error: Unprocessable Entity for url: https://c5hhcabur7dqwyj7.us-east-1.aws.endpoints.huggingface.cloud/ (Request ID: nEd4Xz) Make sure 'sentence-similarity' task is supported by the model.
It does work when making the
/similarity
route from TEI explicit:Seems like the route is not set correctly by the client.
Reproduction
No response
Logs
No response
System info
The text was updated successfully, but these errors were encountered: