samwit commited on
Commit
819b848
1 Parent(s): 4def2c3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ This is a fine-tuning of the LLaMa13B model in the style of the Alpaca dataset and setting but using LoRa.
2
+
3
+ For details of the data and hyper params - https://crfm.stanford.edu/2023/03/13/alpaca.html
4
+
5
+ This repo only contains the LoRa weights and not the original LLaMa weights which are research only.