Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference

Update modeling_mpt.py

#16
by ybelkada - opened

This PR adds the accelerate support for MPT models so that any user could load these models in 8bit / 4bit

abhi-mosaic changed pull request status to merged

Sign up or log in to comment