Update README.md
Browse files
README.md
CHANGED
@@ -116,37 +116,23 @@ Refer to the Provided Files table below to see what files use which methods, and
|
|
116 |
|
117 |
**Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
|
118 |
|
119 |
-
###
|
120 |
|
121 |
-
**Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded
|
122 |
|
123 |
<details>
|
124 |
-
<summary>Click for instructions regarding
|
125 |
|
126 |
-
|
127 |
-
Please download:
|
128 |
-
* `falcon-180b.Q6_K.gguf-split-a`
|
129 |
-
* `falcon-180b.Q6_K.gguf-split-b`
|
130 |
-
|
131 |
-
### q8_0
|
132 |
-
Please download:
|
133 |
-
* `falcon-180b.Q8_0.gguf-split-a`
|
134 |
-
* `falcon-180b.Q8_0.gguf-split-b`
|
135 |
-
|
136 |
-
To join the files, do the following:
|
137 |
|
138 |
Linux and macOS:
|
139 |
```
|
140 |
-
cat falcon-180b.
|
141 |
-
cat falcon-180b.Q8_0.gguf-split-* > falcon-180b.Q8_0.gguf && rm falcon-180b.Q8_0.gguf-split-*
|
142 |
```
|
143 |
Windows command line:
|
144 |
```
|
145 |
-
COPY /B falcon-180b.
|
146 |
-
del falcon-180b.
|
147 |
-
|
148 |
-
COPY /B falcon-180b.Q8_0.gguf-split-a + falcon-180b.Q8_0.gguf-split-b falcon-180b.Q8_0.gguf
|
149 |
-
del falcon-180b.Q8_0.gguf-split-a falcon-180b.Q8_0.gguf-split-b
|
150 |
```
|
151 |
|
152 |
</details>
|
|
|
116 |
|
117 |
**Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
|
118 |
|
119 |
+
### All files are split and require joining after download
|
120 |
|
121 |
+
**Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded all files as split files
|
122 |
|
123 |
<details>
|
124 |
+
<summary>Click for instructions regarding joining files</summary>
|
125 |
|
126 |
+
To join the files, use the following example for each file you're interested in:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
127 |
|
128 |
Linux and macOS:
|
129 |
```
|
130 |
+
cat falcon-180b.Q2_K.gguf-split-* > falcon-180b.Q2_K.gguf && rm falcon-180b.Q2_K.gguf-split-*
|
|
|
131 |
```
|
132 |
Windows command line:
|
133 |
```
|
134 |
+
COPY /B falcon-180b.Q2_K.gguf-split-a + falcon-180b.Q2_K.gguf-split-b falcon-180b.Q2_K.gguf
|
135 |
+
del falcon-180b.Q2_K.gguf-split-a falcon-180b.Q2_K.gguf-split-b
|
|
|
|
|
|
|
136 |
```
|
137 |
|
138 |
</details>
|