runtime error
00:00, 36.7MB/s] Downloading pytorch_model.bin: 100%|ββββββββββ| 1.88G/1.88G [00:51<00:00, 36.2MB/s] Downloading (β¦)rocessor_config.json: 0%| | 0.00/432 [00:00<?, ?B/s] Downloading (β¦)rocessor_config.json: 100%|ββββββββββ| 432/432 [00:00<00:00, 3.55MB/s] Downloading (β¦)okenizer_config.json: 0%| | 0.00/904 [00:00<?, ?B/s] Downloading (β¦)okenizer_config.json: 100%|ββββββββββ| 904/904 [00:00<00:00, 6.48MB/s] Downloading (β¦)olve/main/vocab.json: 0%| | 0.00/798k [00:00<?, ?B/s] Downloading (β¦)olve/main/vocab.json: 100%|ββββββββββ| 798k/798k [00:00<00:00, 55.4MB/s] Downloading (β¦)olve/main/merges.txt: 0%| | 0.00/456k [00:00<?, ?B/s] Downloading (β¦)olve/main/merges.txt: 100%|ββββββββββ| 456k/456k [00:00<00:00, 131MB/s] Downloading (β¦)/main/tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] Downloading (β¦)/main/tokenizer.json: 100%|ββββββββββ| 2.11M/2.11M [00:00<00:00, 34.1MB/s] Downloading (β¦)cial_tokens_map.json: 0%| | 0.00/548 [00:00<?, ?B/s] Downloading (β¦)cial_tokens_map.json: 100%|ββββββββββ| 548/548 [00:00<00:00, 5.24MB/s] Downloading (β¦)lve/main/config.json: 0%| | 0.00/6.95k [00:00<?, ?B/s] Downloading (β¦)lve/main/config.json: 100%|ββββββββββ| 6.95k/6.95k [00:00<00:00, 44.4MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 31, in <module> blip2_model_8_bit = Blip2ForConditionalGeneration.from_pretrained("Salesforce/blip2-opt-6.7b", device_map="auto", load_in_8bit=True) File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2634, in from_pretrained raise ImportError( ImportError: Using `load_in_8bit=True` requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes `pip install -i https://test.pypi.org/simple/ bitsandbytes` or pip install bitsandbytes`
Container logs:
Fetching error logs...