Finetuning Query for gpt-oss
OpenAI Developer Community
February 10, 2026
Thank you so much BEN for your quick support and time, I will surely try all the things that you mentioned.
1 last question you mentioned to use thinking, I am using harmony format and it has the <|end|> as thinking eos for analysis channel and then final message will start so should i change this entirely as per your suggestion will it lead to catastrophic forgetting
How we should also take care of
1. Catastrophic forgetting
2. Routing collapse in MoE
3. NaN/diverging loss
4. Overfittig
Thank you once again..
Discussion in the ATmosphere