Edit model card

PhoGPT-4B-Chat.GGUF

GGUF format files of the model vinai/PhoGPT-4B-Chat.

Model Details

For detailed information about the original model, please refer to phoGPT's repository.

Select and download the quantization version that fits the needs.

GGUF

Model size

3.75B params

Architecture

mpt

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples

Inference API (serverless) has been turned off for this model.

Base model

Quantized

(2)

this model