{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihfcer2epyz5gbqtkmnirlxiwytn6eapjcke6z25dtgyyd7x54fim",
    "uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3mjf6djugge22"
  },
  "path": "/t/peft-0-18-1-crashing-when-fine-tuning-part-2/175227#post_1",
  "publishedAt": "2026-04-13T14:50:42.000Z",
  "site": "https://discuss.huggingface.co",
  "tags": [
    "@John6666",
    "@BenjaminB"
  ],
  "textContent": "Hi @John6666 @BenjaminB,\n\nThank you so much for your amazing feedback! I appreciate it! The previous topic closed and I couldn’t add to it so I created this new one.\n\nBy trial and error, I’m now using the following filter and it stopped the crash. I’m not sure if it’s working 100% for the fine-tuning. I’m still checking. Training Loss is still high. I don’t know if impacted by the filter or other factors e.g. dtype=torch.bfloat16 conversion …\n\ntarget_modules=r\"model\\\\.language_model\\\\..*\\\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)\",",
  "title": "Peft 0.18.1 crashing when fine-tuning - Part 2"
}