split files?
#2
by
sirus
- opened
This doesn't seem to load with any loader in oobabooga. Do we have to unsplit the model after downloading?
Yes you have to join the files together. Using the Q2 as an example, here's how you do it. If there are more split files, then you'll need all of them and you'll have to edit the windows command accordingly.
Linux and macOS:
cat falcon-180b.Q2_K.gguf-split-* > falcon-180b.Q2_K.gguf && rm falcon-180b.Q2_K.gguf-split-*
Windows command line:
COPY /B falcon-180b.Q2_K.gguf-split-a + falcon-180b.Q2_K.gguf-split-b falcon-180b.Q2_K.gguf
del falcon-180b.Q2_K.gguf-split-a falcon-180b.Q2_K.gguf-split-b