Hugging Face's logo

Cas-Warehouse
/
Llama-3-SOVL-MopeyMule-8B

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Casual-Autopsy commited on
Commit
93052eb
•
1 Parent(s): 5d8af08

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. README.md +7 -7
  2. config.json +1 -1
  3. mergekit_config.yml +1 -1
  4. model-00001-of-00004.safetensors +2 -2
  5. model-00002-of-00004.safetensors +2 -2
  6. model-00003-of-00004.safetensors +2 -2
  7. model-00004-of-00004.safetensors +2 -2
README.md CHANGED
@@ -1,16 +1,16 @@
1
  ---
2
  base_model:
3
  - failspy/Llama-3-8B-Instruct-MopeyMule
4
- - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
5
  - failspy/Llama-3-8B-Instruct-MopeyMule
6
  - ResplendentAI/Luna_Llama3
7
  - failspy/Llama-3-8B-Instruct-MopeyMule
8
- - ResplendentAI/BlueMoon_Llama3
9
- - failspy/Llama-3-8B-Instruct-MopeyMule
10
- - failspy/Llama-3-8B-Instruct-MopeyMule
11
  - ResplendentAI/Aura_Llama3
12
  - failspy/Llama-3-8B-Instruct-MopeyMule
 
 
13
  - ResplendentAI/Smarts_Llama3
 
 
14
  library_name: transformers
15
  tags:
16
  - mergekit
@@ -29,11 +29,11 @@ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522)
29
  ### Models Merged
30
 
31
  The following models were included in the merge:
32
- * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
33
  * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
34
- * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
35
  * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
 
36
  * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
 
37
 
38
  ### Configuration
39
 
@@ -48,5 +48,5 @@ models:
48
  - model: failspy/Llama-3-8B-Instruct-MopeyMule+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
49
  merge_method: model_stock
50
  base_model: failspy/Llama-3-8B-Instruct-MopeyMule
51
- dtype: float16
52
  ```
 
1
  ---
2
  base_model:
3
  - failspy/Llama-3-8B-Instruct-MopeyMule
 
4
  - failspy/Llama-3-8B-Instruct-MopeyMule
5
  - ResplendentAI/Luna_Llama3
6
  - failspy/Llama-3-8B-Instruct-MopeyMule
 
 
 
7
  - ResplendentAI/Aura_Llama3
8
  - failspy/Llama-3-8B-Instruct-MopeyMule
9
+ - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
10
+ - failspy/Llama-3-8B-Instruct-MopeyMule
11
  - ResplendentAI/Smarts_Llama3
12
+ - failspy/Llama-3-8B-Instruct-MopeyMule
13
+ - ResplendentAI/BlueMoon_Llama3
14
  library_name: transformers
15
  tags:
16
  - mergekit
 
29
  ### Models Merged
30
 
31
  The following models were included in the merge:
 
32
  * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
 
33
  * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
34
+ * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
35
  * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
36
+ * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
37
 
38
  ### Configuration
39
 
 
48
  - model: failspy/Llama-3-8B-Instruct-MopeyMule+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
49
  merge_method: model_stock
50
  base_model: failspy/Llama-3-8B-Instruct-MopeyMule
51
+ dtype: bfloat16
52
  ```
config.json CHANGED
@@ -22,7 +22,7 @@
22
  "rope_scaling": null,
23
  "rope_theta": 500000.0,
24
  "tie_word_embeddings": false,
25
- "torch_dtype": "float16",
26
  "transformers_version": "4.41.0",
27
  "use_cache": true,
28
  "vocab_size": 128256
 
22
  "rope_scaling": null,
23
  "rope_theta": 500000.0,
24
  "tie_word_embeddings": false,
25
+ "torch_dtype": "bfloat16",
26
  "transformers_version": "4.41.0",
27
  "use_cache": true,
28
  "vocab_size": 128256
mergekit_config.yml CHANGED
@@ -6,4 +6,4 @@ models:
6
  - model: failspy/Llama-3-8B-Instruct-MopeyMule+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
7
  merge_method: model_stock
8
  base_model: failspy/Llama-3-8B-Instruct-MopeyMule
9
- dtype: float16
 
6
  - model: failspy/Llama-3-8B-Instruct-MopeyMule+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
7
  merge_method: model_stock
8
  base_model: failspy/Llama-3-8B-Instruct-MopeyMule
9
+ dtype: bfloat16
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc20e14079f27bb1e83cad47e344a48d07122ff950ca0d17a1aaa65f312e0122
3
- size 4953586328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b1e8ebc09d5b1b3e475be946b77dc52ff9098d86f84d841181c57cb71daeb96
3
+ size 4953586384
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:583a4f80919a1f30291f256c5080da9506498dde65bedd5016925cfb51681a77
3
- size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30bb923116943cc3e96288a33294352763a3b60f6b2696626c047104b9eb1c88
3
+ size 4999819336
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eee9827d9993bae986fd02dfc5b9b9cd1f2ba34b24214af3ff4953f9c905739a
3
- size 4915916048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:753e54880cf9c9822b8f12c7d57658872521485cfbdfb965a0fef8434f982e4d
3
+ size 4915916144
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fffbc98956c6f6eebf967f87f4af0520a95d15ba85b308ed57b783ebe5587862
3
- size 1191234448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:362836de47b5732015c442ea6ee512d801df96e09cf56ba20b6630fdb88f8791
3
+ size 1191234472