External Publication
Visit Post

Are there any LLMs that can run with decent performance on hardware comparable to Jetson NX?

Hugging Face Forums [Unofficial] March 16, 2026
Source
Hi, I’m working to make an AI agent for robotics application. We plan to use Jetson AGX or NX, and want to run all the models locally if available, without using cloud or on-premise server. But then I found out that the memory bottleneck is too harsh. I have tried several models including Llama, Qwen, Gemma (7~9B), but they were too slow. Some of them even did not run. Is there any language model that can solve my problem? The agent would be used for various tasks including on-site diagnosis, production of operator-ready summaries, and more.

Discussion in the ATmosphere

Loading comments...