GPT-4o returning malformed Unicode like \u0000e6 instead of æ — encoding bug?
OpenAI Developer Community
June 25, 2026
Welcome new user with a web site to promote, multiple old thread bumper.
The AI can certainly write \u000000000000999 if it wants. Just as it could write the correct multi-byte Unicode code point if it wanted to and does in the majority of the cases for a topic creator that says “occasionally”.
The API cannot “ban escaped unicode sequences”.
The answer you seek: logprobs.
Get the actual predictions of tokens, and alternates that the AI is making.
You’ll see this is a training issue, likely large amounts of 8-bit code pages were ingested in corpus with flaky conversion on these models, two years old, and even more major fault with this symptom was seen in the initial release of gpt-4-turbo.
Discussion in the ATmosphere