Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: 优化 Chat 的载入及为其创建一个简易 server #124

Merged
merged 3 commits into from
Oct 30, 2024

Conversation

TogetsuDo
Copy link
Contributor

老破小载入chat有点慢,独立出来单独加载了,然后想想好像换成api调用更方便,还能给我的轻量云用(

docs/AIDeployment.md Outdated Show resolved Hide resolved
docs/AIDeployment.md Outdated Show resolved Hide resolved
docs/AIDeployment.md Outdated Show resolved Hide resolved
src/plugins/chat/__init__.py Show resolved Hide resolved
src/plugins/chat/api.py Outdated Show resolved Hide resolved
src/plugins/repeater/model.py Outdated Show resolved Hide resolved
.env Outdated
@@ -96,9 +96,18 @@ COMMAND_START=["","/"]
#请参考 https://zhuanlan.zhihu.com/p/618011122 配置 strategy
#CHAT_STRATEGY=cuda fp16

# 是否使用本地 api
#chat_use_local_api = False
Copy link
Owner

@MistEO MistEO Oct 30, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

所以这里也应该改名叫 chat_use_server 之类的(

以及代码里的

.env Outdated
Comment on lines 102 to 106
#chat api超时时间,机子差可以设长一点
#chat_timeout = 15

#chat api重试次数
#chat_retry = 3
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

chat_server_timeout chat_server_retry?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

请求的超时时间和请求重试的次数

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

我是说改个变量名,要么 chat_server_request_timeout, chat_server_request_retry,反正把 server 带上去毕竟是个可选功能

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

下划线多了真不好看(

@MistEO MistEO merged commit f119a35 into MistEO:master Oct 30, 2024
1 check failed
@MistEO MistEO changed the title feat: 优化Chat的载入及为其创建一个简易api feat: 优化 Chat 的载入及为其创建一个简易 server Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants