HP ProDesk 600 G6 Microtower w/ 550W PSU, GPU recommendations?

[Klr650]

Trying to fit as much GPU as I can on my budget into a Prodesk with a 550W PSU (does have 2 6+2 power connectors). For running LLMs. Was thinking the 3060 12GB and a 3050 6GB (8GB would exceed the PSU) but I have concerns with the height above the PCIe bracket. It is limited and there is a case cross-member towards the other end to deal with. The 3050 is easily available in LP but I am not holding my breath to find a rare 3060 in that configuration. Fortunately both PCIe slots appear to be double-width. Next thought was (2) NVIDIA Quadro RTX 4000 (Turing). 16GB total, within the power constraints, and at least at the bracket end appears it would fit under the cover. Although a right angle power adapter would probably be required. Issue is length. That case bracket sits lower and probably will hit. I am not TOTALLY against the thought of removing it (and probably the associated CD drive) but thought I would ask if anyone here has put anything different or better in. I am thinking 16GB is the low end of the VRAM I need to minimize layer offloading and low TPS speeds. Thoughts?

[NonSequitur777]

@Klr650,

Welcome to our HP Community forum!

I would recommend using a single, capable graphics card rather than two cards.  I don't think your particular PC can utilize twin cards in any advantageous setup for you anyway.

One of the very best graphics card options given your 550-watt power supply is no doubt an RTX 5060 Ti 16GB GDDR7, which can be purchased for less than $480 via Amazon, such as this quality purchase option: https://www.amazon.com/Gigabyte-GeForce-WINDFORCE-Graphics-GV-N506TWF2OC-16GD/dp/B0F4NHSHSQ/ref=sr_1....

Kind Regards,

NonSequitur777

[Klr650]

I don't think the 5060 will fit. It will run into that same frame cross-piece I mentioned. Even if it was not there I don't think the MicroTower panel could be put back on as it also projects well above the top of the PCIe slot. LLM programs are set up to utilize multiple GPUs. Yes the x4 PCIe will cause a slight bottleneck, but not that significant for running instances like this (compared to the fact I will still be offloading layers to RAM).

[NonSequitur777]

@Klr650,

You said you got the MT (Microtower) model, and therefore a smaller-sized (dual) fan RTX 5060 Ti measuring 208 mm (8.2 inches) in length should fit, even if you have to remove a small case section:

Kind Regards,

NonSequitur777