erlend123 commited on
Commit
b010b32
1 Parent(s): ce8022a

Model save

Browse files
README.md CHANGED
@@ -18,9 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.0894
22
- - Accuracy: 0.9417
23
- - F1: 0.9392
24
 
25
  ## Model description
26
 
@@ -40,26 +40,26 @@ More information needed
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 2e-05
43
- - train_batch_size: 16
44
- - eval_batch_size: 16
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - num_epochs: 10
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|
54
- | 0.0912 | 1.0 | 20841 | 0.0922 | 0.9423 | 0.9436 |
55
- | 0.097 | 2.0 | 41682 | 0.0894 | 0.9417 | 0.9392 |
56
- | 0.0808 | 3.0 | 62523 | 0.0937 | 0.9419 | 0.9393 |
57
- | 0.0852 | 4.0 | 83364 | 0.0989 | 0.9424 | 0.9397 |
58
 
59
 
60
  ### Framework versions
61
 
62
  - Transformers 4.39.3
63
- - Pytorch 1.13.0+cu117
64
  - Datasets 2.18.0
65
  - Tokenizers 0.15.2
 
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.7875
22
+ - Accuracy: 0.4685
23
+ - F1: 0.4357
24
 
25
  ## Model description
26
 
 
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 2e-05
43
+ - train_batch_size: 32
44
+ - eval_batch_size: 32
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
+ - num_epochs: 5
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
53
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|
54
+ | 1.85 | 1.0 | 4296 | 1.8051 | 0.4689 | 0.4157 |
55
+ | 1.7268 | 2.0 | 8592 | 1.7875 | 0.4685 | 0.4357 |
56
+ | 1.6381 | 3.0 | 12888 | 1.7995 | 0.4602 | 0.4358 |
57
+ | 1.5568 | 4.0 | 17184 | 1.8209 | 0.4573 | 0.4337 |
58
 
59
 
60
  ### Framework versions
61
 
62
  - Transformers 4.39.3
63
+ - Pytorch 2.2.1+cu121
64
  - Datasets 2.18.0
65
  - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8a82608c6fd1805cdd57722169f44c0d26821a71e7c6c39e2a64422227801540
3
  size 267912544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35b13ae5c45382a826066202152df01b7c157d336c186aa3d56fcb6017b82eed
3
  size 267912544
runs/Apr15_14-06-48_DESKTOP-TE1H4IM/events.out.tfevents.1713185252.DESKTOP-TE1H4IM.22564.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26c82403ebfa370e28db70b227c58c1b17c28209b6e842f8771f8caa194651a1
3
+ size 416