bartowski
/

Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (3)

Missing Tensors in Q5_K_S + Q5_K_M

#8 opened 4 months ago by

Digital-At-Work-Christopher

Abliterated quant?

#7 opened 4 months ago by

tensor 'output_norm.weight' not found

#5 opened 4 months ago by

<23GB quant for 24GB GPUs? IQ2_XS or IQ2_XXS?

#4 opened 4 months ago by

Q5KL has wrong number of tensors

#3 opened 4 months ago by