tdot604 commited on
Commit
1c3c402
1 Parent(s): 26f8012

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ base_model:
4
+ - TheDrummer/Moist-Miqu-70B-v1
5
+ - Sao10K/L3-70B-Euryale-v2.1
6
+ library_name: transformers
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+
11
+ ---
12
+ # Result
13
+
14
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
+
16
+ ## Merge Details
17
+ ### Merge Method
18
+
19
+ This model was merged using the passthrough merge method.
20
+
21
+ ### Models Merged
22
+
23
+ The following models were included in the merge:
24
+ * [TheDrummer/Moist-Miqu-70B-v1](https://huggingface.co/TheDrummer/Moist-Miqu-70B-v1)
25
+ * [Sao10K/L3-70B-Euryale-v2.1](https://huggingface.co/Sao10K/L3-70B-Euryale-v2.1)
26
+
27
+ ### Configuration
28
+
29
+ The following YAML configuration was used to produce this model:
30
+
31
+ ```yaml
32
+ slices:
33
+ - sources:
34
+ - model: Sao10K/L3-70B-Euryale-v2.1
35
+ layer_range: [0, 16]
36
+ - sources:
37
+ - model: TheDrummer/Moist-Miqu-70B-v1
38
+ layer_range: [8, 24]
39
+ - sources:
40
+ - model: Sao10K/L3-70B-Euryale-v2.1
41
+ layer_range: [17, 32]
42
+ - sources:
43
+ - model: TheDrummer/Moist-Miqu-70B-v1
44
+ layer_range: [25, 40]
45
+ - sources:
46
+ - model: Sao10K/L3-70B-Euryale-v2.1
47
+ layer_range: [33, 48]
48
+ - sources:
49
+ - model: TheDrummer/Moist-Miqu-70B-v1
50
+ layer_range: [41, 56]
51
+ - sources:
52
+ - model: Sao10K/L3-70B-Euryale-v2.1
53
+ layer_range: [49, 64]
54
+ - sources:
55
+ - model: TheDrummer/Moist-Miqu-70B-v1
56
+ layer_range: [57, 72]
57
+ - sources:
58
+ - model: Sao10K/L3-70B-Euryale-v2.1
59
+ layer_range: [65, 80]
60
+ merge_method: passthrough
61
+ dtype: float16
62
+ ```