Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for Gemini models #402

Open
mnvsk97 opened this issue Nov 1, 2024 · 2 comments
Open

Add support for Gemini models #402

mnvsk97 opened this issue Nov 1, 2024 · 2 comments
Labels
enhancement New feature or request llm integration

Comments

@mnvsk97
Copy link
Contributor

mnvsk97 commented Nov 1, 2024 •
edited
Loading

  • Models and providers should be configurable from models_config.yaml
  • Add support to inference servers that are not OpenAI compatible.
@mnvsk97 mnvsk97 added llm integration enhancement New feature or request labels Nov 5, 2024
@AbhishekRP2002
Copy link
Contributor

hi @mnvsk97 if this is not taken up yet by anyone, I would love to take this up and contribute.

  • I think for the first point we have to update model_gateway.py and model_config.sample.yaml
  • for the second one, can u please explain a little more ?

@AbhishekRP2002
Copy link
Contributor

any updates on this ? @mnvsk97

cc: @chiragjn

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request llm integration
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mnvsk97 @AbhishekRP2002