reeducator
commited on
Commit
•
516ec16
1
Parent(s):
25564df
Update README
Browse files
README.md
CHANGED
@@ -10,18 +10,15 @@ language:
|
|
10 |
- en
|
11 |
---
|
12 |
## General
|
13 |
-
Vicuna 1.1 13B finetune incorporating various datasets in addition to the unfiltered ShareGPT. This is an experiment attempting to enhance the creativity of the Vicuna 1.1, while also reducing censorship as much as possible.
|
14 |
-
All datasets have been cleaned. Additionally, only the "instruct" portion of GPTeacher has been used.
|
15 |
|
16 |
## Models
|
17 |
-
*GGML
|
18 |
ggml-vicuna-13b-cocktail-v1-q5_0.bin<br/>
|
19 |
|
20 |
*GPTQ 4-bit CUDA:*<br/>
|
21 |
vicuna-13b-cocktail-v1-4bit-128g.safetensors<br/>
|
22 |
|
23 |
-
Tokenizer and configs can be found in `hf-output`.
|
24 |
-
|
25 |
## Remarks
|
26 |
This model has been trained with a modified prompt:<br/>
|
27 |
```
|
@@ -30,4 +27,4 @@ USER: [user message]
|
|
30 |
ASSOCIATE: [model reply]</s>
|
31 |
```
|
32 |
|
33 |
-
The training roles are USER and ASSOCIATE.
|
|
|
10 |
- en
|
11 |
---
|
12 |
## General
|
13 |
+
Vicuna 1.1 13B finetune incorporating various datasets in addition to the unfiltered ShareGPT. This is an experiment attempting to enhance the creativity of the Vicuna 1.1, while also reducing censorship as much as possible. All datasets have been cleaned. Additionally, only the "instruct" portion of GPTeacher has been used.
|
|
|
14 |
|
15 |
## Models
|
16 |
+
*GGML quant for llama.cpp:*<br/>
|
17 |
ggml-vicuna-13b-cocktail-v1-q5_0.bin<br/>
|
18 |
|
19 |
*GPTQ 4-bit CUDA:*<br/>
|
20 |
vicuna-13b-cocktail-v1-4bit-128g.safetensors<br/>
|
21 |
|
|
|
|
|
22 |
## Remarks
|
23 |
This model has been trained with a modified prompt:<br/>
|
24 |
```
|
|
|
27 |
ASSOCIATE: [model reply]</s>
|
28 |
```
|
29 |
|
30 |
+
The training roles are USER and ASSOCIATE.
|