ai-forever

/

ruBert-base

like 26

Help me with the tensor error. How can I fix it ?

RuntimeError: The size of tensor a (1024) must match the size of tensor b (512) at non-singleton dimension 1

I'm running simple training from the box.

python run_mlm.py \
    --model_name_or_path ai-forever/ruBert-base \
    --train_file ./mlm-data.csv \
    --per_device_train_batch_size 16 \
    --do_train \
    --output_dir ./model

Have a good day!