[Feature]: Could OpenRouter be supported?

[MeNicefellow]

Feature Request

OpenRouter supports a more diverse range of LLMs to be used. So, could you add support to it?

Motivation / Problem

Currently the supported providers do not include OpenRouter.

Use Case

What use case?

Proposed Solution

Just add OpenRouter

Alternatives Considered

No response

Priority

Low - Nice to have

Implementation Complexity (if known)

None

Additional Context

No response

Checklist

• I have searched existing issues and feature requests to ensure this is not a duplicate
• I have provided a clear use case and motivation for this feature
• I am willing to help test this feature once implemented
• I am interested in contributing to the implementation of this feature

[sami-marreed]

Hi, @MeNicefellow, isn't OpenRouter basically litellm ? if not we will look into it

[MeNicefellow]

Hi, @MeNicefellow, isn't OpenRouter basically litellm ? if not we will look into it

Yes, basically, but I added the .env:

OPENAI_API_KEY="my_real_api_key"
AGENT_SETTING_CONFIG="settings.openai.toml"
OPENAI_BASE_URL="https://openrouter.ai/api/v1"

And when I start demo, it shows:

[sami-marreed]

Please also update MODEL_NAME env variable with one in openrouter

[MeNicefellow]

Please also update MODEL_NAME env variable with one in openrouter

[sami-marreed]

try

openai/gpt-4o, then restart the server

if it didn't work we will have fix hy tomorrowl

[MeNicefellow]

try

openai/gpt-4o, then restart the server

if it didn't work we will have fix hy tomorrowl

Restarted server with openai/gpt-4o as model name, still doesn't work. Which log should I check to see the reason?

[sami-marreed]

we will test this by sunday and provide a fix

[dolev31]

Hello @MeNicefellow, in the new release we added OpenRouter support. All information is in the README.md and cuga docs (https://docs.cuga.dev/docs/customization/llm-config/)

The new variables you should make sure exist:

OPENROUTER_API_KEY="your-api-key"
OPENROUTER_BASE_URL="https://openrouter.ai/api/v1"
AGENT_SETTING_CONFIG="settings.openrouter.toml" # Override the default
MODEL_NAME="openai/gpt-4o" # or any model from openrouter.ai/models (to change the default model)

Please let us know if you encounter any issues!

[MeNicefellow]

@dolev31 Thank you for the update! I met the problem in the screenshot now when trying to access localhost:7860 after starting the demo:

Something went wrong
crypto.randomUUID is not a function

Reload Page

[sami-marreed]

@dolev31 can you follow up?