Provide pytorch_model pickle files

by bmskje38 - opened Oct 31, 2023

Oct 31, 2023

Hi,

Thanks so much for this release. The zephyr-7b-alpha had the pytorch_model_*.bin version beside the safetensors. Is it possible to also include this format in the next release or on a branch?

Thank you

lewtun

Hugging Face H4 org Nov 1, 2023

Hi @bmskje38 , sure I can do that! Out of curiosity, what is the advantage of the pickle files over the safetensors ones?

bmskje38

Nov 2, 2023

Thanks @lewtun ! There are existing free projects and tooling that use pickle files and don't all support safetensors, making it easier for compatibility.

digitous

Nov 2, 2023

Also want to say thanks @lewtun as well; I have scripts, some original, some built on others' work that employ different model merge techniques; I don't have safetensor support implemented in my builds yet, so it's always nice to see some old fashioned pickles :D

Zephyr is awesome, thank you all for the hard work!

lewtun

Hugging Face H4 org Nov 4, 2023

Thanks for the info @bmskje38 and @digitous - I've just merged https://huggingface.co/HuggingFaceH4/zephyr-7b-beta/discussions/20 which adds the pickle files 🤗

FYI safetensors is now the default in transformers, so I recommend updating your codebases to support this format (as it's much safer!)

lewtun changed discussion status to closed Nov 4, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment