Commit
•
5d5d297
1
Parent(s):
dd752c4
Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ Available [here](https://huggingface.co/macadeliccc/MBX-7B-v3-DPO-GGUF/tree/main
|
|
| 35 |
|
| 36 |
## Evaluations
|
| 37 |
|
| 38 |
-
## EQ-Bench
|
| 39 |
|
| 40 |
<pre>----Benchmark Complete----
|
| 41 |
2024-01-30 15:22:18
|
|
@@ -50,6 +50,20 @@ Time taken: 145.9 mins
|
|
| 50 |
---------------
|
| 51 |
</pre>
|
| 52 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
| 54 |
|-----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
| 55 |
|[MBX-7B-v3-DPO](https://huggingface.co/macadeliccc/MBX-7B-v3-DPO)| 45.16| 77.73| 74.62| 48.83| 61.58|
|
|
|
|
| 35 |
|
| 36 |
## Evaluations
|
| 37 |
|
| 38 |
+
## EQ-Bench Comparison
|
| 39 |
|
| 40 |
<pre>----Benchmark Complete----
|
| 41 |
2024-01-30 15:22:18
|
|
|
|
| 50 |
---------------
|
| 51 |
</pre>
|
| 52 |
|
| 53 |
+
### Original Model
|
| 54 |
+
<pre>----Benchmark Complete----
|
| 55 |
+
2024-01-31 01:26:26
|
| 56 |
+
Time taken: 89.1 mins
|
| 57 |
+
Prompt Format: Mistral
|
| 58 |
+
Model: flemmingmiguel/MBX-7B-v3
|
| 59 |
+
Score (v2): 73.87
|
| 60 |
+
Parseable: 168.0
|
| 61 |
+
---------------
|
| 62 |
+
Batch completed
|
| 63 |
+
Time taken: 89.1 mins
|
| 64 |
+
---------------
|
| 65 |
+
</pre>
|
| 66 |
+
|
| 67 |
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
| 68 |
|-----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
| 69 |
|[MBX-7B-v3-DPO](https://huggingface.co/macadeliccc/MBX-7B-v3-DPO)| 45.16| 77.73| 74.62| 48.83| 61.58|
|