LlamaFinetuneBase
commited on
Commit
•
5f047a2
1
Parent(s):
b6bf5eb
Upload original\params.json with huggingface_hub
Browse files- original//params.json +1 -0
original//params.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"dim": 4096, "ffn_dim_multiplier": 1.3, "multiple_of": 1024, "n_heads": 32, "n_kv_heads": 8, "n_layers": 32, "norm_eps": 1e-05, "rope_theta": 500000.0, "use_scaled_rope": true, "vocab_size": 128256}
|