Mistral large doesn't use space before [/inst]. Was it trained with the space?
Also was sys prompt at depth 0 or beginning? I'm finding the og model follows examples better when placed in the classic spot. At least at short ctx.
· Sign up or log in to comment