External Publication
Visit Post

Looking for suggestions for a LLM dedicated server build?

AnandTech Forums: Technology, Hardware, Software, and Deals [Un… May 23, 2026
Source
Hello. I was assigned to set up a LLM server with a budget of 14000 USD aprox. I've built gaming builds before but I'm completely new in terms of Large Language Model. I just started the process of reading all the information and videos available on the internet about this, and I thought I would ask for advice here to see if I can start getting suggestions while I gather more information. How much storage space would we need for the models and other data? Is it better to have two 4090's or four 3090's as the GPU's? Any other suggestions on GPUs for this budget? How much RAM would we need? For the motherboard and CPU I was thinking of: Motherboard: Gigabyte B650 EAGLE AX CPU: AMD Ryzen 5 9600X I'm also thinking on building this on a GPU rack since it will be placed in an open space with little to no dust. Does that sound good? Any other tips of matters that I might not have thought of?

Discussion in the ATmosphere

Loading comments...