Looks like the app isn't working anymore

#21
by andrewrreed HF staff - opened

I get an error about queue size being too large. Would be great to have this up and working again!

accelerate org

Thanks! Probably due to the outtage. Looks to be working now for me, can you confirm?

Yes, seems to be working for me now as well. Thanks!

andrewrreed changed discussion status to closed
andrewrreed changed discussion status to open

Hmmm wait - my first attempt worked, but now seeing issues when trying on a second model

not working for me

accelerate org

Can you guys provide me with reproducers please? What models are we using :)

accelerate org

Looks like it's hanging, investigating.

accelerate org

Okay restarted again... Let's try one more time? Might be a weird spaces infra issue.

Ok seems to be working now! Tested several times with several models and looks good. Thanks!

Seems like it doesn't work again..

accelerate org

Thanks for the report @kiucho . I'm rebuilding one final time to see if this pr fixed it https://github.com/huggingface/accelerate/pull/2435, and I'll keep an eye on this thread for the next few days. If we hit a queue again/freeze I'll report this to the team

It seems like it is hitting the queue again :/

For me it just perma-loads with a queue message ๐Ÿ˜ž

accelerate org

Thanks all, asking infra to help out with this as it's a critical issue!

The issue was due to a bug of huggingface_hub==0.20.3. https://github.com/huggingface/huggingface_hub/pull/1962
As huggingface_hub==0.19.4 doesn't have the bug, I pinned the version for now. https://huggingface.co/spaces/hf-accelerate/model-memory-usage/discussions/22

Thank you, it's back in business! This is a super useful utility!

Screenshot 2024-02-16 at 20.03.27.png

accelerate org

Closing as we're working again thanks to @hysts sharp deduction skills :)

muellerzr changed discussion status to closed

Sign up or log in to comment