Update README.md
Browse files
README.md
CHANGED
|
@@ -58,7 +58,11 @@ The `safetensors` model file was created with the latest GPTQ code, and uses `--
|
|
| 58 |
|
| 59 |
If you want to use the `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
|
| 60 |
```
|
| 61 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
git clone https://github.com/oobabooga/text-generation-webui
|
| 63 |
mkdir -p text-generation-webui/repositories
|
| 64 |
ln -s GPTQ-for-LLaMa text-generation-webui/repositories/GPTQ-for-LLaMa
|
|
|
|
| 58 |
|
| 59 |
If you want to use the `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
|
| 60 |
```
|
| 61 |
+
# We need to clone GPTQ-for-LLaMa as of April 13th, due to breaking changes in more recent commits
|
| 62 |
+
git clone -n https://github.com/qwopqwop200/GPTQ-for-LLaMa gptq-safe
|
| 63 |
+
cd gptq-safe && git checkout 58c8ab4c7aaccc50f507fd08cce941976affe5e0
|
| 64 |
+
|
| 65 |
+
# Now clone text-generation-webui, if you don't already have it
|
| 66 |
git clone https://github.com/oobabooga/text-generation-webui
|
| 67 |
mkdir -p text-generation-webui/repositories
|
| 68 |
ln -s GPTQ-for-LLaMa text-generation-webui/repositories/GPTQ-for-LLaMa
|