relaxml/Llama-2-7b-QTIP-4Bit
Updated
•
60
•
2
QTIP Quantized Models
See https://github.com/Cornell-RelaxML/qtip
-
-
relaxml/Llama-2-7b-QTIP-3Bit
Updated • 47 • 1 -
relaxml/Llama-2-7b-chat-QTIP-3Bit
Updated • 40 -
relaxml/Llama-2-13b-QTIP-3Bit
Updated • 217 -
relaxml/Llama-2-13b-chat-QTIP-3Bit
Updated • 30 -
relaxml/Llama-2-70b-QTIP-3Bit
Updated • 38 -
relaxml/Llama-2-70b-chat-QTIP-3Bit
Updated • 26 -
relaxml/Llama-2-7b-chat-QTIP-4Bit
Updated • 21 -
relaxml/Llama-2-13b-QTIP-4Bit
Updated • 36 -
relaxml/Llama-2-13b-chat-QTIP-4Bit
Updated • 23 -
relaxml/Llama-2-70b-QTIP-4Bit
Updated • 34 -
relaxml/Llama-2-70b-chat-QTIP-4Bit
Updated • 22 -
relaxml/Llama-2-70b-chat-QTIP-2Bit
Updated • 31 -
relaxml/Llama-2-70b-QTIP-2Bit
Updated • 38 -
relaxml/Llama-2-13b-chat-QTIP-2Bit
Updated • 17 -
relaxml/Llama-2-13b-QTIP-2Bit
Updated • 46 -
relaxml/Llama-2-7b-QTIP-2Bit
Updated • 273 -
relaxml/Llama-2-7b-chat-QTIP-2Bit
Updated • 292 • 1 -
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
Updated • 72 • 2 -
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
Updated • 36 -
relaxml/Llama-3.1-8b-Instruct-QTIP-2Bit
Updated • 109 • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
Updated • 11 -
relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit-TP8
Updated • 4 • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit-TP8
Updated -
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit-TP8
Updated • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
Updated • 2 • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit
Updated • 10 • 2