TheBloke
/

Vicuna-13B-1.1-GPTQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

TheBloke commited on Apr 16, 2023

Commit

d32191a

•

1 Parent(s): c303fec

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -43,7 +43,7 @@ Details of the files provided:
   * `safetensors` format, with improved file security, created with the latest [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa) code.
   * Command to create:
     * `python3 llama.py vicuna-13B-1.1-HF c4 --wbits 4 --true-sequential --act-order --groupsize 128 --save_safetensors vicuna-13B-1.1-GPTQ-4bit-128g.safetensors`
-* vicuna-13B-1.1-GPTQ-4bit-128g.no-act-order.pt`
   * `pt` format file, created without the `--act-order` flag.
   * This file may have slightly lower quality, but is included as it can be used without needing to compile the latest GPTQ-for-LLaMa code.
   * It should hopefully therefore work with one-click-installers on Windows, which include the older GPTQ-for-LLaMa code.

   * `safetensors` format, with improved file security, created with the latest [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa) code.
   * Command to create:
     * `python3 llama.py vicuna-13B-1.1-HF c4 --wbits 4 --true-sequential --act-order --groupsize 128 --save_safetensors vicuna-13B-1.1-GPTQ-4bit-128g.safetensors`
+* `vicuna-13B-1.1-GPTQ-4bit-128g.no-act-order.pt`
   * `pt` format file, created without the `--act-order` flag.
   * This file may have slightly lower quality, but is included as it can be used without needing to compile the latest GPTQ-for-LLaMa code.
   * It should hopefully therefore work with one-click-installers on Windows, which include the older GPTQ-for-LLaMa code.