Transformers
falcon
TheBloke commited on
Commit
5ec0b35
1 Parent(s): c930688

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -21
README.md CHANGED
@@ -116,37 +116,23 @@ Refer to the Provided Files table below to see what files use which methods, and
116
 
117
  **Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
118
 
119
- ### Q6_K and Q8_0 files are split and require joining
120
 
121
- **Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the Q6_K and Q8_0 files as split files.
122
 
123
  <details>
124
- <summary>Click for instructions regarding Q6_K and Q8_0 files</summary>
125
 
126
- ### q6_K
127
- Please download:
128
- * `falcon-180b.Q6_K.gguf-split-a`
129
- * `falcon-180b.Q6_K.gguf-split-b`
130
-
131
- ### q8_0
132
- Please download:
133
- * `falcon-180b.Q8_0.gguf-split-a`
134
- * `falcon-180b.Q8_0.gguf-split-b`
135
-
136
- To join the files, do the following:
137
 
138
  Linux and macOS:
139
  ```
140
- cat falcon-180b.Q6_K.gguf-split-* > falcon-180b.Q6_K.gguf && rm falcon-180b.Q6_K.gguf-split-*
141
- cat falcon-180b.Q8_0.gguf-split-* > falcon-180b.Q8_0.gguf && rm falcon-180b.Q8_0.gguf-split-*
142
  ```
143
  Windows command line:
144
  ```
145
- COPY /B falcon-180b.Q6_K.gguf-split-a + falcon-180b.Q6_K.gguf-split-b falcon-180b.Q6_K.gguf
146
- del falcon-180b.Q6_K.gguf-split-a falcon-180b.Q6_K.gguf-split-b
147
-
148
- COPY /B falcon-180b.Q8_0.gguf-split-a + falcon-180b.Q8_0.gguf-split-b falcon-180b.Q8_0.gguf
149
- del falcon-180b.Q8_0.gguf-split-a falcon-180b.Q8_0.gguf-split-b
150
  ```
151
 
152
  </details>
 
116
 
117
  **Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
118
 
119
+ ### All files are split and require joining after download
120
 
121
+ **Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded all files as split files
122
 
123
  <details>
124
+ <summary>Click for instructions regarding joining files</summary>
125
 
126
+ To join the files, use the following example for each file you're interested in:
 
 
 
 
 
 
 
 
 
 
127
 
128
  Linux and macOS:
129
  ```
130
+ cat falcon-180b.Q2_K.gguf-split-* > falcon-180b.Q2_K.gguf && rm falcon-180b.Q2_K.gguf-split-*
 
131
  ```
132
  Windows command line:
133
  ```
134
+ COPY /B falcon-180b.Q2_K.gguf-split-a + falcon-180b.Q2_K.gguf-split-b falcon-180b.Q2_K.gguf
135
+ del falcon-180b.Q2_K.gguf-split-a falcon-180b.Q2_K.gguf-split-b
 
 
 
136
  ```
137
 
138
  </details>