{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreiciy7pduw6jc5xqo3ajw52mmb45kxpiqfkkin25mltgkddwvzbxei",
    "uri": "at://did:plc:lk3jfj3zq4k4wxnk474axylu/app.bsky.feed.post/3mejkisxxl7o2"
  },
  "path": "/t/finetuning-query-for-gpt-oss/1373859#post_5",
  "publishedAt": "2026-02-10T17:09:53.000Z",
  "site": "https://community.openai.com",
  "textContent": "I would say at first attempts it gives good output, short queries it works, for longer and complex examples it happens.\n\nComing to Data - I prepared it with GPT 5.2 with longer and shorter samples with analysis as well.\n\nFor EOS <|return|>, channel <|end|>, is handled proper and extra validation checks are there also I used harmony github repo creating conversation.\n\nTemperature: Tried 1 and 0,0.3 as well, repeating penalties, top k=20,30,top p=0.9, num predict.\n\nThank you for your support and guidance\n\nPlease let me know how should I tackle this and your guidance to do a successful fine tuning with custom dataset.\n\nMy question:\n\n1. Your guidance on the above thinking loop.\n\n  2. Do I add analysis channel data into training or not.\n  3. Custom chat template to work with inference and training later ollama compatibility\n  4. My max sample token is 8k most of the samples have 3,4k token and smaller as well.\n  5. Which quant is best q4, 5,8 or any other\n\n",
  "title": "Finetuning Query for gpt-oss"
}