File size: 1,061 Bytes
b81d6ed 7a28e62 fa54747 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
inference: false
license: other
language:
- en
model_name: Samantha 1.1 Llama 33B
quantized_by: iandennismiller
base_model: ehartford/samantha-1.1-llama-33b
datasets:
- ehartford/samantha-data
---
# Eric Hartford's Samantha 1.1 Llama 33B GGUF
Samantha 1.1 is a very smart model.
For those of us with 24gb usable RAM (including Apple Silicon with 32gb RAM), this is just about the best model available as of October, 2023.
I've converted the model to GGUF for the sake of compatibility.
Currently, only Q4_K_S is available because that's the largest model that runs in 24gb.
For more information, see [Eric Hartford's Samantha 1.1 Llama 33B](https://huggingface.co/ehartford/samantha-1.1-llama-33b).
To examine the original quant, see [TheBloke/samantha-1.1-llama-33B-GGML](https://huggingface.co/TheBloke/samantha-1.1-llama-33B-GGML)
The particular quants selected for this repo are in support of [calm](https://github.com/iandennismiller/calm), which is a language model runner that automatically uses the right prompts, templates, context size, etc.
|