How to set the max length from 512 to 2048?

#11
by kk3dmax - opened

How to set the max length from 512 to 2048?

embed_model.client.max_seq_length = 2048 is what I found, not sure is it correct.

Beijing Academy of Artificial Intelligence org

The max length for bge is limited to 512. For sentences whose length is larger than 512, it will process only the first 512 tokens.
Therefore, setting the max_seq_length has no effect. We suggest splitting the long document into several passages.

ok, thanks for your clairify.

Sign up or log in to comment