Commit
•
3de3f01
1
Parent(s):
5db0201
Update README.md
Browse files
README.md
CHANGED
|
@@ -168,6 +168,12 @@ Then install the latest version of `transformers` as follows:
|
|
| 168 |
pip install "transformers>=4.43.0" --upgrade
|
| 169 |
```
|
| 170 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 171 |
And then, run the following script, adapted from [AutoGPTQ/examples/quantization/basic_usage.py](https://github.com/AutoGPTQ/AutoGPTQ/blob/main/examples/quantization/basic_usage.py).
|
| 172 |
|
| 173 |
```python
|
|
|
|
| 168 |
pip install "transformers>=4.43.0" --upgrade
|
| 169 |
```
|
| 170 |
|
| 171 |
+
Finally, in order to use `autogptq`, `optimum` also needs to be installed:
|
| 172 |
+
|
| 173 |
+
```bash
|
| 174 |
+
pip install optimum --upgrade
|
| 175 |
+
```
|
| 176 |
+
|
| 177 |
And then, run the following script, adapted from [AutoGPTQ/examples/quantization/basic_usage.py](https://github.com/AutoGPTQ/AutoGPTQ/blob/main/examples/quantization/basic_usage.py).
|
| 178 |
|
| 179 |
```python
|