Update README.md

README.md

@@ -1,9 +1,52 @@
 ---
 library_name: peft
+tags:
+- code
+- instruct
+- falcon
+datasets:
+- HuggingFaceH4/no_robots
+base_model: tiiuae/falcon-7b
+license: apache-2.0
 ---
-## Training procedure
 
-### Framework versions
+### Finetuning Overview:
 
+**Model Used:** tiiuae/falcon-7b 
 
-- PEFT 0.5.0
+**Dataset:** HuggingFaceH4/no_robots  
+
+#### Dataset Insights:
+
+[No Robots](https://huggingface.co/datasets/HuggingFaceH4/no_robots) is a high-quality dataset of 10,000 instructions and demonstrations created by skilled human annotators. This data can be used for supervised fine-tuning (SFT) to make language models follow instructions better.
+
+#### Finetuning Details:
+
+With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](https://docs.monsterapi.ai/fine-tune-a-large-language-model-llm), this finetuning:
+
+- Was achieved with great cost-effectiveness.
+- Completed in a total duration of 1h 21m 21s for 3 epochs using an A6000 48GB GPU.
+- Costed `$0.909` for the entire epoch.
+
+#### Hyperparameters & Additional Details:
+
+- **Epochs:** 3
+- **Cost Per Epoch:** $0.909
+- **Total Finetuning Cost:** $2.727
+- **Model Path:** tiiuae/falcon-7b
+- **Learning Rate:** 0.0002
+- **Data Split:** 100% train
+- **Gradient Accumulation Steps:** 4
+- **lora r:** 32
+- **lora alpha:** 64
+
+
+####  Prompt Structure
+```
+<|system|> <|endoftext|> <|user|> [USER PROMPT]<|endoftext|> <|assistant|> [ASSISTANT ANSWER] <|endoftext|>
+```
+#### Train loss :
+
+![training loss](https://cdn-uploads.huggingface.co/production/uploads/63ba46aa0a9866b28cb19a14/SUIuXqIg2X_NmA3WsgVBp.png)
+
+license: apache-2.0