File size: 1,631 Bytes
d91a33e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
2023-06-26 20:18:16 - finetune_bloom.py[line:65] - INFO: args.__dict__ : {'model_config_file': 'run_config/Bloom_config.json', 'deepspeed': 'run_config/deepspeed_config.json', 'resume_from_checkpoint': False, 'lora_hyperparams_file': '', 'use_lora': False, 'local_rank': 0}
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: model_type : bloom
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: model_name_or_path : baichuan-inc/baichuan-7B
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: data_path : data/data_tmp.json
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: output_dir : checkpoints/baichuan_chat
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: batch_size : 64
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: per_device_train_batch_size : 2
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: num_epochs : 2
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: learning_rate : 1e-05
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: cutoff_len : 1024
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: val_set_size : 0
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: val_set_rate : 0
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: save_steps : 3000
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: eval_steps : 1000
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: warmup_steps : 10
2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: logging_steps : 10
2023-06-28 14:13:45 - finetune_bloom.py[line:226] - INFO: Save checkpointing...
2023-06-28 14:19:46 - finetune_bloom.py[line:232] - INFO: Training succeeded
|