Embedding a local LLM directly into an indie interrogation game

Have you considered having your game load the model weights in from a folder? Then someone with less VRAM available could stick a smaller model in there whilst someone with more VRAM could choose a more beefier model to use. Then players won’t have to redownload the weights everytime you update the game/rebuild the .exe (I’m assuming that when you say build size you’re referring to everything being inside of a singular compiled file/application). You’d probably want to have the game start with a small LLM downloaded into the folder incase people want to jump right in/can’t figure out how to download model weights.