Dealing with escape characters when using models built on the BERT architecture

Hi! I am currently working on a research project and I will be using a model built on the BERT architecture for the first time. My question is, should I remove any escape characters (e.g., \n) in the pre-processing stage, or would this instead worsen the performance of the model. Thank you!