Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
This is a fine-tuning of the LLaMa13B model in the style of the Alpaca dataset and setting but using LoRa.
|
2 |
+
|
3 |
+
For details of the data and hyper params - https://crfm.stanford.edu/2023/03/13/alpaca.html
|
4 |
+
|
5 |
+
This repo only contains the LoRa weights and not the original LLaMa weights which are research only.
|