Creation steps / conversion differences to transformers.js

#1
by do-me - opened

Thanks a lot for the fork!
Could you provide the steps/scripts how to create this transformers.js compatible onnx version? I'd like to apply them myself to other models.

For anyone wondering why the gte and e5 model families don't work out of the box, @Xenova explained the problem here (and here).

Supabase org

Hey @do-me , Xenova has some great docs on how to convert models to ONNX here:
https://huggingface.co/docs/transformers.js/custom_usage#convert-your-models-to-onnx

Thanks @ggrn - I was aware of the scripts, I just got confused when testing some models with transformers.js. I thought I encountered an error with Xenova's gte-small version, found yours to be working and was wondering what you did differently - but that's not the case, they are both working. Instead, there's only an issue with multilingual-e5-* models as mentioned in the GitHub issue.

do-me changed discussion status to closed

Sign up or log in to comment