falan42
/

llama_lora_8b_medical_HealthcareMagictr2_gguf

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

falan42 commited on Sep 21

Commit

8c91f46

•

1 Parent(s): b2df785

(Trained with Unsloth)

Files changed (1) hide show

Modelfile +1 -1

Modelfile CHANGED Viewed

@@ -1,5 +1,5 @@
-FROM ./emir12/llama_lora_8b_medical_HealthcareMagictr2_gguf/unsloth.Q8_0.gguf
 TEMPLATE """{{ if .System }}<|system|>
 {{ .System }}<|end|>
 {{ end }}{{ if .Prompt }}<|user|>

+FROM ./emir12/llama_lora_8b_medical_HealthcareMagictr2_gguf/unsloth.F16.gguf
 TEMPLATE """{{ if .System }}<|system|>
 {{ .System }}<|end|>
 {{ end }}{{ if .Prompt }}<|user|>