Has the weights file not been uploaded yet?
#1
by
wawoshashi
- opened
no weights file
They are up now, but they are a bit too large to run on 2x 3090/4090 GPUs. I quantized again to g256 and I think they fit now but still testing.