No model is being evaluated

#289
by Martinichigo - opened

I've noticed that the pending queue is rather long but no model is being evaluated now. @clefourrier @thomwolf

Martinichigo changed discussion title from No enough GPUs? to No model is being evaluated
Open LLM Leaderboard org
edited Sep 18, 2023

Hi @AI-coolie, we indeed used the GPUs at our disposition for other purposes during the weekend. The models you see pending are all models submitted and not ran during those 2 days. We are however restarting the evaluation right now, and you should see models be evaluated again quite quickly !

SaylorTwift changed discussion status to closed

Hi @AI-coolie, we indeed used the GPUs at our disposition for other purposes during the weekend. The models you see pending are all models submitted and not ran during those 2 days. We are however restarting the evaluation right now, and you should see models be evaluated again quite quickly !

Thank you! Shall I re-submit the model after your restart?@SaylorTwift

Martinichigo changed discussion status to open
Open LLM Leaderboard org

If your model is in the PENDING queue then it will be evaluated and you do not need to do anything. If at one point you see that your model has failed, don't hesitate to re-open the thread and we will solve the issue :)

SaylorTwift changed discussion status to closed

Sign up or log in to comment