Unrecognized Symbols
#7
by
migtissera
- opened
Hi there!
I am getting outputs resembling the following:
1. Gauss's Law for Electricity: ��� = ρ_ext / ε_0
2. Gauss's Law for Magnetism: ��� = 0
3. Faraday's Law of Induction: ��E = −��/��
4. Ampere's Law: ��B = μ_0(��H) + J
Wondering whether this is an issue with your tokenizer. Can you please advice?
Thank you!
Migel Tissera
Hi @migtissera ,
Thanks for reporting!
Here we need more information to check this case.
- The prompt and the encoded ids
- The generated token ids.
As it seems like this thread has become inactive, we will be closing this discussion for now.
If you have any further questions, feel free to reopen this discussion or start a new one.
Thank you for your contribution to this community!
richardllin
changed discussion status to
closed