-
Notifications
You must be signed in to change notification settings - Fork 573
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for custom OpenAI-Compatible backends #1231
Comments
An ability to use custom backends is really required. Azure OpenAI supporting as well. Even as a paid feature. |
Yes, AzureOpenAI support, please. |
We've open-sourced the OpenAI API logic (https://github.com/BloopAI/bloop/tree/oss/server/bleep/src/llm). You can now build and run bloop with a custom OpenAI API key (see: https://github.com/BloopAI/bloop?tab=readme-ov-file#building-from-source). Feel free to open a PR adding support for Azure OpenAI 😀 |
What's the problem?
Usage of local large language models through LocalAI, LMStudio and so on, all of these are providing OpenAI-compatible API, but application need to expose a setting to change baseurl.
What's the outcome?
Related Issues: #415 #1094
The text was updated successfully, but these errors were encountered: