lewtun HF staff autoevaluator HF staff commited on
Commit
b047d6a
1 Parent(s): 5a17152

Add evaluation results on xsum dataset (#2)

Browse files

- Add evaluation results on xsum dataset (5607f0182d43ebd582201f345d8167e2d0921260)
- Merge branch 'main' into pr/2 (dddd426cc6b2832527019a254827ecca1a8f3dfb)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -38,6 +38,39 @@ model-index:
38
  type: gen_len
39
  value: 20.3122
40
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
41
  ---
42
 
43
  ### Pegasus Models
 
38
  type: gen_len
39
  value: 20.3122
40
  verified: true
41
+ - task:
42
+ type: summarization
43
+ name: Summarization
44
+ dataset:
45
+ name: xsum
46
+ type: xsum
47
+ config: default
48
+ split: test
49
+ metrics:
50
+ - name: ROUGE-1
51
+ type: rouge
52
+ value: 46.8623
53
+ verified: true
54
+ - name: ROUGE-2
55
+ type: rouge
56
+ value: 24.4533
57
+ verified: true
58
+ - name: ROUGE-L
59
+ type: rouge
60
+ value: 39.0548
61
+ verified: true
62
+ - name: ROUGE-LSUM
63
+ type: rouge
64
+ value: 39.0994
65
+ verified: true
66
+ - name: loss
67
+ type: loss
68
+ value: 1.5717021226882935
69
+ verified: true
70
+ - name: gen_len
71
+ type: gen_len
72
+ value: 22.8821
73
+ verified: true
74
  ---
75
 
76
  ### Pegasus Models