Migel Tissera
commited on
Commit
•
f50cb6d
1
Parent(s):
10aeb07
updated readme
Browse files
README.md
CHANGED
@@ -7,7 +7,6 @@ library_name: transformers
|
|
7 |
---
|
8 |
|
9 |
# Synthia-13B
|
10 |
-
|
11 |
SynthIA (Synthetic Intelligent Agent) is a LLama-2-13B model trained on Orca style datasets. It has been fine-tuned for instruction following as well as having long-form conversations.
|
12 |
|
13 |
<br>
|
@@ -16,12 +15,11 @@ SynthIA (Synthetic Intelligent Agent) is a LLama-2-13B model trained on Orca sty
|
|
16 |
|
17 |
<br>
|
18 |
|
19 |
-
|
20 |
<br>
|
21 |
|
22 |
#### License Disclaimer:
|
23 |
|
24 |
-
This model is bound by the license & usage restrictions of the original Llama-2 model
|
25 |
|
26 |
<br>
|
27 |
|
@@ -31,7 +29,14 @@ We evaluated Synthia-13B on a wide range of tasks using [Language Model Evaluati
|
|
31 |
|
32 |
Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
33 |
|
34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
|
36 |
<br>
|
37 |
|
|
|
7 |
---
|
8 |
|
9 |
# Synthia-13B
|
|
|
10 |
SynthIA (Synthetic Intelligent Agent) is a LLama-2-13B model trained on Orca style datasets. It has been fine-tuned for instruction following as well as having long-form conversations.
|
11 |
|
12 |
<br>
|
|
|
15 |
|
16 |
<br>
|
17 |
|
|
|
18 |
<br>
|
19 |
|
20 |
#### License Disclaimer:
|
21 |
|
22 |
+
This model is bound by the license & usage restrictions of the original Llama-2 model, and comes with no warranty or gurantees of any kind.
|
23 |
|
24 |
<br>
|
25 |
|
|
|
29 |
|
30 |
Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
31 |
|
32 |
+
|||||
|
33 |
+
|:------:|:--------:|:-------:|
|
34 |
+
|**Task**|**Metric**|**Value**|
|
35 |
+
|*arc_challenge*|acc_norm|0.5998|
|
36 |
+
|*hellaswag*|acc_norm|0.8186|
|
37 |
+
|*mmlu*|acc_norm|0.5611|
|
38 |
+
|*truthfulqa_mc*|mc2|0.4741|
|
39 |
+
|**Total Average**|-|**0.6134**||
|
40 |
|
41 |
<br>
|
42 |
|