BAAI/bge-reranker-v2-gemma · Output does not make sense

May 22

Using the below snippet:

from FlagEmbedding import FlagLLMReranker
reranker = FlagLLMReranker('BAAI/bge-reranker-v2-gemma', use_fp16=True) # Setting use_fp16 to True speeds up computation with a slight performance degradation
# reranker = FlagLLMReranker('BAAI/bge-reranker-v2-gemma', use_bf16=True) # You can also set use_bf16=True to speed up computation with a slight performance degradation

score = reranker.compute_score(['query', 'passage'])
print(score)

gives

[-0.279052734375, 4.14453125]

When only a single score is expected?

cfli

May 22

I test it, but I get a single score of '1.9775390625'.

aarabil

May 22

Rerun the snippet, and now it works as expected. I believe something went wrong during model loading the first time. Thanks for the quick check!

aarabil changed discussion status to closed May 22