typo
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ The model recipe was as follows:
|
|
13 |
- Linear merge of **Orca-2-13b** @0.8 and **cat-v1.0-13b** @0.2 = OrcaCat-13b (no plans to release)
|
14 |
- Gradient SLERP merge of **Noromaid-v0.1.1** @0.5 and **OrcaCat-13b** @0.5 = OrcaMaid-13b
|
15 |
|
16 |
-
Both merges were done in FP32 rather than FP16, due to Orca being
|
17 |
|
18 |
The overall goal of this merge is to create a model that sounds uniquely human and natural, without sacrificing intelligence.
|
19 |
|
|
|
13 |
- Linear merge of **Orca-2-13b** @0.8 and **cat-v1.0-13b** @0.2 = OrcaCat-13b (no plans to release)
|
14 |
- Gradient SLERP merge of **Noromaid-v0.1.1** @0.5 and **OrcaCat-13b** @0.5 = OrcaMaid-13b
|
15 |
|
16 |
+
Both merges were done in FP32 rather than FP16, due to Orca being released as FP32. I didn't want to risk losing any precision.
|
17 |
|
18 |
The overall goal of this merge is to create a model that sounds uniquely human and natural, without sacrificing intelligence.
|
19 |
|