Hugging Face's logo

Aryanne
/
OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf

GGUF
English
Inference Endpoints
Model card Files Community
Edit model card

Some GGUF v2 quantizations of the model harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>
Downloads last month
68
GGUF
Model size
3.43B params
Architecture
llama

4-bit

5-bit

Inference API
Unable to determine this model's library. Check the docs .

Dataset used to train Aryanne/OpenLlama-3B-v2-WizardEvol-Instruct-v2-gguf