CohereForAI

/

c4ai-command-r-v01-4bit

like 171

Follow

Cohere For AI 610

update transformers to 4.39.1 or higher

@drinkingxi
Thanks. I have used transformers==4.39.3 and python=3.9.16, but I have faced above error. Would you please help me to address it? (In fact, I downloaded the model, about 20 days ago, and then move it from my home/.cache/huggingface/hub to another folder and then when I want to load it from this new address I faced above error. When I remove it completely and want to download it again, I also faced above error.)

same error.
I resolved it by removing the auto_map key from config.json and adding exist_ok=True to the arguments of the register function in the last lines of configuration_cohere.py and tokenization_cohere_fast.py.
I'm not sure why this is happening, but...

@leonaci
Thanks a lot for your help. But, I got following error again (after removing the auto_map key from config.json ):

OSError: It looks like the config file at '/HuggingFace_Models/c4ai/models--CohereForAI--c4ai-command-r-v01-4bit/snapshots/183f6e1182a46c223dde00ebf1ace9194ea221aa/config.json' is not a valid JSON file.

@ahkarami

not a valid JSON file

Are you sure there aren't any syntax errors in your JSON? (like a trailing comma or something...)
Check it out carefully again.

Why is such a fundamental issue still open after a month?