neuralmagic
/

Nous-Hermes-2-Yi-34B-pruned50

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mwitiderrick commited on Mar 5

Commit

fc3f2b9

•

1 Parent(s): 43a4e1a

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -77,6 +77,7 @@ test_stage:
     SparseGPTModifier:
       sparsity: 0.5
       sequential_update: true
       targets: ['re:model.layers.\d*$']
 """

     SparseGPTModifier:
       sparsity: 0.5
       sequential_update: true
+      mask_structure: 0:0
       targets: ['re:model.layers.\d*$']
 """