tensor size mismatch
#9
by
Daemontatox
- opened
283 # LoRA is enabled
284 A, B = A.t(), B.t()
--> 285 out += (X @ A.to(dtype)) @ (s * B.to(dtype))
286 pass
287
RuntimeError: The size of tensor a (4096) must match the size of tensor b (3072) at non-singleton dimension 1
raise ValueError(
ValueError: Trying to set a tensor of shape torch.Size([1024, 3072]) in "weight" (which has shape torch.Size([768, 3072])), this look incorrect.
I am also facing same issue
Install transformers from source using the following to get the latest version. It will work.
pip install git+https://github.com/huggingface/transformers