beamaia commited on
Commit
83a494b
1 Parent(s): fabe7ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -10
README.md CHANGED
@@ -75,16 +75,17 @@ The following hyperparameters were used during training:
75
  - lr_scheduler_type: cosine
76
  - num_steps: 0
77
  - quantization_type: bitsandbytes
78
- - LoRA: - bits: 4
79
- - use_exllama: True
80
- - device_map: auto
81
- - use_cache: False
82
- - lora_r: 8
83
- - lora_alpha: 16
84
- - lora_dropout: 0.1
85
- - bias: none
86
- - target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj']
87
- - task_type: CAUSAL_LM
 
88
 
89
  ### Training results
90
 
 
75
  - lr_scheduler_type: cosine
76
  - num_steps: 0
77
  - quantization_type: bitsandbytes
78
+ - LoRA:
79
+ - bits: 4
80
+ - use_exllama: True
81
+ - device_map: auto
82
+ - use_cache: False
83
+ - lora_r: 8
84
+ - lora_alpha: 16
85
+ - lora_dropout: 0.1
86
+ - bias: none
87
+ - target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj']
88
+ - task_type: CAUSAL_LM
89
 
90
  ### Training results
91