TheBloke
/

h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GPTQ

Text Generation

large language model

text-generation-inference

4-bit precision

Model card Files Files and versions Community

h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GPTQ

1 contributor

History: 12 commits

TheBloke's picture

Update for Transformers GPTQ support

338d574 about 1 year ago