OOM Error

#13

by shuyuej - opened Aug 4

Aug 4

/usr4/ec523/brucejia/.local/lib/python3.10/site-packages/accelerate/utils/modeling.py:1405: UserWarning: Current model requires 45201611776 bytes of buffer for offloaded layers, which seems does not fit any GPU's remaining memory. If you are experiencing a OOM later, please consider using offload_buffers=True.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment