Peft 0.18.1 crashing when fine-tuning - Part 2

Hi @John6666 @BenjaminB,

Thank you so much for your amazing feedback! I appreciate it! The previous topic closed and I couldn’t add to it so I created this new one.

By trial and error, I’m now using the following filter and it stopped the crash. I’m not sure if it’s working 100% for the fine-tuning. I’m still checking. Training Loss is still high. I don’t know if impacted by the filter or other factors e.g. dtype=torch.bfloat16 conversion …

target_modules=r"model\.language_model\..*\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",