External Publication
Visit Post

Token size if planning to use LLM while running a game?

Hugging Face Forums [Unofficial] February 13, 2026
Source
Absolute beginner. First post about my first project. Trying to decide on the appropriate model to use for what will essentially be a chatbot running while I’m in a game. A quick google search says my 16GB VRAM Nvidia 4080 and 64GB of RAM could handle something thats 14-22B, should I dial it back to something like Mistral 7B if the game itself recommends a 1070 (8GB VRAM)?

Discussion in the ATmosphere

Loading comments...