Skip to content

Commit 05224d2

Browse files
authored
Add support for Vicuna 7B and 13B (#903)
1 parent 6e58157 commit 05224d2

File tree

2 files changed

+28
-0
lines changed

2 files changed

+28
-0
lines changed

README.md

+1
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,7 @@ Instructions for setting up Serge on Kubernetes can be found in the [wiki](https
6060
| **CodeLLaMA** | 7B, 13B |
6161
| **LLaMA** | 7B, 13B, 70B |
6262
| **Mistral** | 7B-Instruct, 7B-OpenOrca |
63+
| **Vicuna** | 7B-v1.5, 13B-v1.5 |
6364
| **Zephyr** | 7B-Alpha, 7B-Beta |
6465
6566
Additional weights can be added to the `serge_weights` volume using `docker cp`:

api/src/serge/data/models.json

+27
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,31 @@
11
[
2+
{
3+
"name": "Vicuna",
4+
"models": [
5+
{
6+
"name": "Vicuna-7B",
7+
"repo": "TheBloke/vicuna-7B-v1.5-GGUF",
8+
"files": [
9+
{
10+
"name": "q4_K_M",
11+
"filename": "vicuna-7b-v1.5.Q4_K_M.gguf",
12+
"disk_space": 4080000000.0
13+
}
14+
]
15+
},
16+
{
17+
"name": "Vicuna-13B",
18+
"repo": "TheBloke/vicuna-13B-v1.5-GGUF",
19+
"files": [
20+
{
21+
"name": "q4_K_M",
22+
"filename": "vicuna-13b-v1.5.Q4_K_M.gguf",
23+
"disk_space": 7870000000.0
24+
}
25+
]
26+
}
27+
]
28+
},
229
{
330
"name": "CodeLLaMA",
431
"models": [

0 commit comments

Comments
 (0)