haritzpuerto
/

xtremedistil-l6-h256-uncased-squad_1.1

Question Answering

Question Answering

Inference Endpoints

Model card Files Files and versions Community

Edit model card

microsoft/xtremedistil-l6-h256-uncased fined-tuned on SQuAD (https://huggingface.co/datasets/squad)

Hyperparameters:

epochs: 1
lr: 1e-5
train batch sie: 16
optimizer: adamW
lr_scheduler: linear
num warming steps: 0
max_length: 512

Results on the dev set:

'exact_match': 62.66792809839168
'f1': 74.99490608582015

Downloads last month: 7

Inference Examples

Question Answering

Inference API (serverless) is not available, repository is disabled.

Dataset used to train haritzpuerto/xtremedistil-l6-h256-uncased-squad_1.1

Evaluation results

SQuAD EM on SQuAD
validation set self-reported

62.668
SQuAD F1 on SQuAD
validation set self-reported

74.995

View on Papers With Code