mpasila
/

Viking-Magnum-v0.1-7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mpasila commited on Aug 24

Commit

4991602

•

1 Parent(s): d0b45fe

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ LoRA: [mpasila/Viking-Magnum-v0.1-LoRA-7B](https://huggingface.co/mpasila/Viking
 Another thing to note is this was trained with regular LoRA (not quantized/QLoRA) so it should improve the quality a bit. This model's context length is only 4096 so it's trained on that too but I think you can use RoPE with it.
-LoRA rank was 128 and Alpha set to the same.
 # Uploaded  model

 Another thing to note is this was trained with regular LoRA (not quantized/QLoRA) so it should improve the quality a bit. This model's context length is only 4096 so it's trained on that too but I think you can use RoPE with it.
+LoRA rank was 128 and Alpha set to the same. Trained for 1 epoch.
 # Uploaded  model