Create README.md

README.md

@@ -0,0 +1,45 @@
+---
+license: cc-by-nc-4.0
+tags:
+- not-for-all-audiences
+- nsfw
+---
+## Exl2 version of [Undi95/OpenDolphinMaid-4x7b](https://huggingface.co/Undi95/OpenDolphinMaid-4x7b)  
+
+## branch  
+7bh8 : 7bpw h8  
+
+Using ThePile [0007.parquet](https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/resolve/refs%2Fconvert%2Fparquet/default/train/0007.parquet) as dataset  
+ 
+Quantization settings : ```python convert.py -i models/NeverSleep_Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss -o Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-temp4 -cf Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-3.5bpw-h8-exl2 -c 0007.parquet -l 8192 -b 3.5 -hb 8 -ml 8192```  
+### below this line is original readme 
+Merge of OpenHermes and Dolphin with 2x Noromaid DPO, trying to add a little more brain in the model, while being smaller than a 8x7b.
+
+It seems to work well.
+
+<!-- description start -->
+## Description
+
+This repo contains fp16 files of OpenDolphinMaid-4x7b.
+
+<!-- description end -->
+<!-- description start -->
+## Models and LoRA used
+
+- NeverSleep/Noromaid-7B-0.4-DPO x 2
+- teknium/OpenHermes-2.5-Mistral-7B
+- cognitivecomputations/dolphin-2.6-mistral-7b-dpo
+
+<!-- description end -->
+<!-- prompt-template start -->
+## Prompt template: Chatml
+
+```
+<|im_start|>system
+{sysprompt}<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+```
+
+If you want to support me, you can [here](https://ko-fi.com/undiai).