HF transformers integration
#4
by
ybelkada
- opened
This PR introduces the transformers integration which should be on par with: https://github.com/huggingface/transformers/pull/27942 so that any user can use Mixtral-8x7B-Instruct-v0.1 with transformers>=4.36.0 using AutoModelForCausalLM interface.
The config needs a slight modification (mistral -> mixtral) and added all safetensors weights
ybelkada
changed pull request title from
Upload MixtralForCausalLM
to HF transformers integration
pstock
changed pull request status to
merged