Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ datasets:
|
|
12 |
# RWKV v4 world 7B 65k context
|
13 |
|
14 |
This is the model to replace the old rwkv 65k claude model, with special token and lower learning rate to maintain model former abilities.
|
15 |
-
and trained a lots of high quality textbooks with 65k context length.
|
16 |
|
17 |
using it with rwkv runner only need 16G vram.(https://github.com/josStorer/RWKV-Runner)
|
18 |
|
|
|
12 |
# RWKV v4 world 7B 65k context
|
13 |
|
14 |
This is the model to replace the old rwkv 65k claude model, with special token and lower learning rate to maintain model former abilities.
|
15 |
+
and trained a lots of English high quality textbooks and chinese novels with 65k context length.
|
16 |
|
17 |
using it with rwkv runner only need 16G vram.(https://github.com/josStorer/RWKV-Runner)
|
18 |
|