I want to build an AI/LLM app that preserves privacy. Please roast my idea :)

It’ll highly depend on your machine especially size of RAM. Since Qubes OS runs a lot of qubes (aka VMs) simultaneously there is some overhead for sure. I recommend at least 16 GB of RAM, the more the better but this depends on your use cases.