Is Gemma 2 9b works right now as it should?
#2
by
Alastar-Smith
- opened
Is Gemma 2 9b works right now as it should?
Aren't both Gemmas bugged right now?
9B looks fine. A sample of the generation results of UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 are at https://github.com/tatsu-lab/alpaca_eval/blob/c2da8f9fd809154f434bf0537230bf6188a31b9a/results/SPPO-Gemma-2-9B-It-PairRM/model_outputs.json