Do System Prompts Really Make a Big Difference?

Yes they do improve stability, lower parsing errors and hallucinations. So make them short and precise. Example = You are a helpful assistant specialized in finance. Explain answers clearly with examples. Avoid speculation.