Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

idea: Request for more cloud providers (Google AI Studio, Together API, AI Horde) #3859

Open
Anthonyg5005 opened this issue Oct 22, 2024 · 1 comment
Labels
category: model support Support new model, or fix broken model category: providers Local & remote inference providers type: feature request A new feature

Comments

@Anthonyg5005
Copy link

Problem Statement

I don't really need Jan for local stuff as I already use a different inference framework but I like how I can use cloud models with it. There just isn't support for all the different apis I want to mess with.

Feature Idea

Some I think I'd like to see:

  • Google AI studio
  • Together API
  • AI Horde

There's probably a couple more that would be nice to have.

@Anthonyg5005 Anthonyg5005 added the type: feature request A new feature label Oct 22, 2024
@imtuyethan imtuyethan changed the title idea: more cloud apis idea: Request for more cloud providers (Google AI Studio, Together API, AI Horde) Oct 22, 2024
@imtuyethan imtuyethan added category: providers Local & remote inference providers category: model support Support new model, or fix broken model labels Oct 22, 2024
@dan-homebrew
Copy link
Contributor

dan-homebrew commented Oct 22, 2024

@Anthonyg5005 We are working on a "Provider Extension API" this sprint, which will allow anyone to add a Provider Extension:

By this sprint, we will release the Provider Extension API and Docs.

  • With a well documented API, this should hopefully allow us to auto-generate Provider Extensions
  • This will enable us (or the community!) to add the ones you mentioned above without much effort

I am merging this issue into #3824, please follow that issue for more details.

cc @louis-jan @urmauur @imtuyethan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: model support Support new model, or fix broken model category: providers Local & remote inference providers type: feature request A new feature
Projects
Status: Investigating
Development

No branches or pull requests

3 participants