EXL2 quants of c4ai-comman-r-v01
2.60 bits per weight3.00 bits per weight3.75 bits per weight4.00 bits per weight5.00 bits per weight6.00 bits per weight
measurement.json
-