Multi-part load for GGUF
#1
by
tridungduong16
- opened
Thanks for your sharing.
May I ask how we can load two parts for models synthia-70b-v1.1.Q8_0.gguf-split-a and synthia-70b-v1.1.Q8_0.gguf-split-b?
There's a section in the README on that; expand "Click for instructions regarding Q6_K and Q8_0 files"