maddes8cht
commited on
Commit
•
70b59d5
1
Parent(s):
8a29453
"Update README.md"
Browse files
README.md
CHANGED
@@ -17,7 +17,8 @@ Persimmon is a Large language Model from Adept AI. It is trained from Scratch wi
|
|
17 |
This is a preview of adepts persimmon base model.
|
18 |
It i snot based on the model published at https://huggingface.co/adept/persimmon-8b-base but on the ones released on the tar files in https://github.com/persimmon-ai-labs/adept-inference.
|
19 |
As these seems to be slightly different, models based on the huggingface release will follow as soon as possible.
|
20 |
-
## Note: These models do not seem to work with cuda acceleration at the moment.
|
|
|
21 |
|
22 |
---
|
23 |
|
|
|
17 |
This is a preview of adepts persimmon base model.
|
18 |
It i snot based on the model published at https://huggingface.co/adept/persimmon-8b-base but on the ones released on the tar files in https://github.com/persimmon-ai-labs/adept-inference.
|
19 |
As these seems to be slightly different, models based on the huggingface release will follow as soon as possible.
|
20 |
+
## Note: These models do not seem to work with cuda acceleration at the moment.
|
21 |
+
If you are using the Cublas version of Llama.cpp, you need to set `--n-gpu-layers 0` for it to work. (At a later date this may work again with Cuda, so feel free to play with this setting)
|
22 |
|
23 |
---
|
24 |
|