External Publication
Visit Post

Training t5 small, custom training task and dealing with unknown input

Hugging Face Forums [Unofficial] April 11, 2026
Source
Hi I have been working on training t5-small to do a cusgom task for example Endorsement A: Fraudulent Claims Clause – SA200 and convert it to Fraudulent Clause – SA200; This is a very contrived example but hopefully you get the idea. So after training the model is outputting im getting is quite good. The problem I have come across is what the model does if it gets a pievce of text it doesnt understand - “Hi my name is t5.” I would like the model to output nothing. Instead T5 attempts a translation task instead. i would really like to it output nothing in this case. Whati have done so far 1. I played around with appending “summarize” to the input text. But i dont think this is the correct task as it “kind of” worked but removed more text from the original input than i would of liked Any ideas of how i can handle input that doesn’t match with the specific task i am doing? Thank you.

Discussion in the ATmosphere

Loading comments...