ddh0 commited on
Commit
ff45cb7
1 Parent(s): 61ecb02

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -1
README.md CHANGED
@@ -5,4 +5,38 @@ license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
5
  pipeline_tag: text-generation
6
  ---
7
 
8
- Model card coming soon. Uploading model first.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  pipeline_tag: text-generation
6
  ---
7
 
8
+ # OrcaMaid-13b
9
+
10
+ This is a merge of Microsoft's [Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b) and Undi and IkariDev's [Noromaid-v0.1.1-13b](https://huggingface.co/NeverSleep/Noromaid-13b-v0.1.1), with just a touch of Kal'tsit's [cat-v1.0](https://huggingface.co/Doctor-Shotgun/cat-v1.0-13b) mixed in.
11
+
12
+ The model recipe was as follows:
13
+ - Linear merge of **Orca-2-13b** @0.8 and **cat-v1.0-13b** @0.2 = OrcaCat-13b (no plans to release)
14
+ - Gradient SLERP merge of **Noromaid-v0.1.1** @0.5 and **OrcaCat-13b** @0.5 = OrcaMaid-13b
15
+
16
+ The overall goal of this merge is to create a model that sounds uniquely human and natural, without sacrificing intelligence.
17
+
18
+ The prompt format is Alpaca. You can use the standard format as shown, but for best results, you should customize the system prompt to your specific needs.
19
+
20
+ ```
21
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
22
+
23
+ ### Instruction:
24
+ {YOUR MESSAGE HERE}
25
+
26
+ ### Response:
27
+ {BOT MESSAGE HERE}
28
+
29
+
30
+ ```
31
+
32
+ ### Misc. information
33
+ - BOS token is `<s>`
34
+ - EOS token is `</s>`
35
+ - Native context length is `4096`
36
+ - Base model is Llama 2
37
+ - Due to the inclusion of Orca-2-13b, the model is subject to the terms of the [Microsoft Research License](https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE)
38
+
39
+ ### Thanks
40
+ - Thanks to [Charles Goddard](https://github.com/cg123) for his kind help with mergekit
41
+ - Thanks to [Undi](https://ko-fi.com/undiai) and [IkariDev](https://ikaridevgit.github.io/) for Noromaid
42
+ - Thanks to Kal'tsit for Cat. See her original reddit post: [Cat 1.0 is an uncensored, rp model aligned to be useful in all (even spicy)situations](https://www.reddit.com/r/LocalLLaMA/comments/17skxzq/cat_10_is_an_uncensored_rp_model_aligned_to_be/)