Can this model work on cpu?
#21
by
wiseluke
- opened
"Has anyone tried running this on CPU before? I am interested in giving it a try."
does for me. EDIT: GGUF version does. Not tried it native. - EDIT 2: A bit slower than GGUF on same hardware, but ya, it worked.
You can work native as well it's just a model supported by transformers