Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference

Finetuning MPT-7B-Instruct in 4-bit

#33
by rmihaylov - opened

I just created this repo. Finetuning MPT-7B using consumer GPUs.

https://github.com/rmihaylov/mpttune

sam-mosaic changed discussion title from Finetuning MPT-7B-Storywriter in 4-bit to Finetuning MPT-7B-Instruct in 4-bit

Sign up or log in to comment