AI-Engine commited on
Commit
ba23402
1 Parent(s): 3721ffc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -3
README.md CHANGED
@@ -1,3 +1,22 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - gguf
5
+ ---
6
+ GGUF [llama.cpp](https://github.com/ggerganov/llama.cpp) quantized version of:
7
+ - Original model: [Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct)
8
+ - Model creator: [Microsoft](https://huggingface.co/microsoft)
9
+ - [License](https://choosealicense.com/licenses/mit/)
10
+
11
+ ## Recommended Prompt Format (Phi-3)
12
+ ```
13
+ <|system|>
14
+ Provide some context and/or instructions to the model.<|end|>
15
+ <|user|>
16
+ The user’s message goes here<|end|>
17
+ <|assistant|>
18
+ AI message goes here<|end|>
19
+ <|assistant|>
20
+ ```
21
+
22
+ Quant Version: [b3405](https://github.com/ggerganov/llama.cpp/releases/tag/b3405) with [imatrix](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)