apepkuss79 commited on
Commit
7d1d9ca
1 Parent(s): dd874f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -3
README.md CHANGED
@@ -1,3 +1,37 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-7B-Instruct
3
+ license: apache-2.0
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/blob/main/LICENSE
5
+ model_creator: Qwen
6
+ model_name: Qwen2.5-7B-Instruct
7
+ quantized_by: Second State Inc.
8
+ language:
9
+ - en
10
+ pipeline_tag: text-generation
11
+ tags:
12
+ - chat
13
+ ---
14
+
15
+ # Qwen2.5-7B-Instruct-GGUF
16
+
17
+ ## Original Model
18
+
19
+ [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
20
+
21
+ ## Run with Gaianet
22
+
23
+ **Prompt template**
24
+
25
+ prompt template: `chatml`
26
+
27
+ **Context size**
28
+
29
+ chat_ctx_size: `128000`
30
+
31
+ **Run with GaiaNet**
32
+
33
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
34
+
35
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
36
+
37
+ *Quantized with llama.cpp b3751*