Migel Tissera commited on
Commit
f50cb6d
1 Parent(s): 10aeb07

updated readme

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -7,7 +7,6 @@ library_name: transformers
7
  ---
8
 
9
  # Synthia-13B
10
-
11
  SynthIA (Synthetic Intelligent Agent) is a LLama-2-13B model trained on Orca style datasets. It has been fine-tuned for instruction following as well as having long-form conversations.
12
 
13
  <br>
@@ -16,12 +15,11 @@ SynthIA (Synthetic Intelligent Agent) is a LLama-2-13B model trained on Orca sty
16
 
17
  <br>
18
 
19
-
20
  <br>
21
 
22
  #### License Disclaimer:
23
 
24
- This model is bound by the license & usage restrictions of the original Llama-2 model. And comes with no warranty or gurantees of any kind.
25
 
26
  <br>
27
 
@@ -31,7 +29,14 @@ We evaluated Synthia-13B on a wide range of tasks using [Language Model Evaluati
31
 
32
  Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
33
 
34
-
 
 
 
 
 
 
 
35
 
36
  <br>
37
 
 
7
  ---
8
 
9
  # Synthia-13B
 
10
  SynthIA (Synthetic Intelligent Agent) is a LLama-2-13B model trained on Orca style datasets. It has been fine-tuned for instruction following as well as having long-form conversations.
11
 
12
  <br>
 
15
 
16
  <br>
17
 
 
18
  <br>
19
 
20
  #### License Disclaimer:
21
 
22
+ This model is bound by the license & usage restrictions of the original Llama-2 model, and comes with no warranty or gurantees of any kind.
23
 
24
  <br>
25
 
 
29
 
30
  Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
31
 
32
+ |||||
33
+ |:------:|:--------:|:-------:|
34
+ |**Task**|**Metric**|**Value**|
35
+ |*arc_challenge*|acc_norm|0.5998|
36
+ |*hellaswag*|acc_norm|0.8186|
37
+ |*mmlu*|acc_norm|0.5611|
38
+ |*truthfulqa_mc*|mc2|0.4741|
39
+ |**Total Average**|-|**0.6134**||
40
 
41
  <br>
42