Peft 0.18.1 crashing when fine-tuning
Hugging Face Forums [Unofficial]
April 3, 2026
Hi, peft Version: 0.18.1 is crashing when attempting to fine-tune google/gemma-4-E2B. The error msg is shown below. I checked and 0.18.1 is the latest version. Will there be an update soon or is there a workaround? I’d appreciate any help. thanks!
ValueError: Target module Gemma4ClippableLinear(
(linear): Linear(in_features=768, out_features=768, bias=False)
) is not supported. Currently, only the following modules are supported: torch.nn.Linear, torch.nn.Embedding, torch.nn.Conv1d, torch.nn.Conv2d, torch.nn.Conv3d, transformers.pytorch_utils.Conv1D, torch.nn.MultiheadAttention..
Discussion in the ATmosphere