Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Qwen
/
Qwen2-7B-Instruct-GGUF
like
167
Follow
Qwen
2,254
Text Generation
GGUF
English
chat
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
10
Deploy
Use this model
main
Qwen2-7B-Instruct-GGUF
6 contributors
History:
7 commits
jklj077
Update README.md
c3024c6
verified
3 months ago
.gitattributes
Safe
1.56 kB
Upload files
5 months ago
LICENSE
Safe
11.3 kB
Upload files
5 months ago
README.md
Safe
4.82 kB
Update README.md
3 months ago
qwen2-7b-instruct-fp16.gguf
Safe
15.2 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q2_k.gguf
Safe
3.02 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q3_k_m.gguf
Safe
3.81 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q4_0.gguf
Safe
4.44 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q4_k_m.gguf
Safe
4.68 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q5_0.gguf
Safe
5.33 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q5_k_m.gguf
Safe
5.44 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q6_k.gguf
Safe
6.25 GB
LFS
Upload folder using huggingface_hub
5 months ago
qwen2-7b-instruct-q8_0.gguf
Safe
8.1 GB
LFS
Upload folder using huggingface_hub
5 months ago
