[Request] 能否支持在服务端配置模型是否使用客户端请求模式

[EnTaroYan]

🥰 需求描述

能否支持在服务端配置模型是否使用客户端请求模式

🧐 解决方案

添加一个环境变量来控制是否启用客户端请求模式.

📝 补充信息

如果配置了-language_model_settings，用户将无法修改是否使用客户端请求模式
经过测试，本地部署的Ollama模型如果关闭客户端请求模式将无法使用，必须开启才行.

[lobehubbot]

👀 @EnTaroYan

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

🥰 Description of requirements

Can it support configuring the model on the server side and whether to use the client request mode?

🧐 Solution

Add an environment variable to control whether client request mode is enabled.

📝 Supplementary information

If -language_model_settings is configured, the user will not be able to modify whether to use client request mode
After testing, the locally deployed Ollama model cannot be used if the client request mode is turned off. It must be turned on.

[youngzyl]

目前 Google AI Studio 模型也不支持客户端请求模式，导致在较大 Context 的情况下 Vercel 的部署会出现请求超时的问题。

Edited: 不确定是否 Google AI Studio 是否支持这种模式，可能是 API 限制。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Currently, the Google AI Studio model does not support client request mode, resulting in request timeout issues in the deployment of Vercel when the Context is large.

[Superzk1024]

客户端请求模式会明文携带你的 api key 的，如果在服务端配置然后客户端请求的话，你服务端配置的 key 会被完全暴漏

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

The client request mode will carry your api key in plain text. If you configure it on the server and then request it from the client, the key configured on the server will be completely exposed.

[FrankCheungDev]

客户端请求模式会明文携带你的 api key 的，如果在服务端配置然后客户端请求的话，你服务端配置的 key 会被完全暴漏

能否只是支持ollama呢？本地运行ollama还是比较常用的场景

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

The client request mode will carry your api key in plain text. If you configure it on the server and then request it from the client, the key configured on the server will be completely exposed.

Can we just support ollama? Running ollama locally is still a common scenario.