File tree 2 files changed +28
-0
lines changed
2 files changed +28
-0
lines changed Original file line number Diff line number Diff line change @@ -60,6 +60,7 @@ Instructions for setting up Serge on Kubernetes can be found in the [wiki](https
60
60
| **CodeLLaMA** | 7B, 13B |
61
61
| **LLaMA** | 7B, 13B, 70B |
62
62
| **Mistral** | 7B-Instruct, 7B-OpenOrca |
63
+ | **Vicuna** | 7B-v1.5, 13B-v1.5 |
63
64
| **Zephyr** | 7B-Alpha, 7B-Beta |
64
65
65
66
Additional weights can be added to the ` serge_weights` volume using `docker cp`:
Original file line number Diff line number Diff line change 1
1
[
2
+ {
3
+ "name" : " Vicuna" ,
4
+ "models" : [
5
+ {
6
+ "name" : " Vicuna-7B" ,
7
+ "repo" : " TheBloke/vicuna-7B-v1.5-GGUF" ,
8
+ "files" : [
9
+ {
10
+ "name" : " q4_K_M" ,
11
+ "filename" : " vicuna-7b-v1.5.Q4_K_M.gguf" ,
12
+ "disk_space" : 4080000000.0
13
+ }
14
+ ]
15
+ },
16
+ {
17
+ "name" : " Vicuna-13B" ,
18
+ "repo" : " TheBloke/vicuna-13B-v1.5-GGUF" ,
19
+ "files" : [
20
+ {
21
+ "name" : " q4_K_M" ,
22
+ "filename" : " vicuna-13b-v1.5.Q4_K_M.gguf" ,
23
+ "disk_space" : 7870000000.0
24
+ }
25
+ ]
26
+ }
27
+ ]
28
+ },
2
29
{
3
30
"name" : " CodeLLaMA" ,
4
31
"models" : [
You can’t perform that action at this time.
0 commit comments