
Seeking dual 3090 or 4090+3090 and 3090 setup advice for stable ...
Nov 23, 2023 · Any ideas on how I can fit two air-cooled 3090s or 4090+3090 in O11 XL avoiding possible thermal throttling and affecting GPU lifespan? I am reluctantly open to buying a new case if …
NVLink bridge worth it for dual RTX 3090? : r/LocalLLaMA - Reddit
I recently got hold of two RTX 3090 GPUs specifically for LLM inference and training. Everything seems to work well and I can finally fit a 70B model into the VRAM with 4 bit quantization. I am wondering if …
Doesn't a 4090 massively overpower a 3090 for running local LLMs?
Jul 7, 2023 · People seem to consider them both as about equal for the price / performance. I know 4090 doesn't have any more vram over 3090, but in terms of tensor compute according to the specs …
3090 undervolting results. Share yours. : r/nvidia - Reddit
Jan 4, 2022 · I have a PNY 3090 Revel and I was never happy with the temps so I looked into undervolting. Didn’t realize how easy it is. I managed to settle with 1890mhz/850mv with a -270 core …
3090/3080ti owners, what are your stable oc settings? - Reddit
Oct 11, 2021 · All things overclocking go here. Learn to overclock, ask experienced users your questions, boast your rock-stable, sky-high OC and help others!
3090 48GB : r/LocalLLaMA - Reddit
Sep 18, 2023 · I was reading on another subreddit about a gent (presumably) who added another 8GB chip to his EVGA 3070, to bring it up to 16GB VRAM. In the comments, people were discussing the …
How many tokens per second do you guys get with GPUs like 3090
May 16, 2023 · How many tokens per second do you guys get with GPUs like 3090 or 4090? (rtx 3060 12gb owner here)
Why are dual 3090 setups the sweet spot? : r/LocalLLaMA - Reddit
Power and case capacity is fairly easy for dual 3090's or 4090's as well. Also, the high end models tend to be tuned around having 48GB VRAM. You can fit a 70b 5bpw with 32k context in that or go with a …
Is an used rtx 3090 a good option now? : r/nvidia - Reddit
Oct 22, 2022 · People tend to forget that older hardware doesn't get worse lol. 3090 is still an amazing gpu, for 600-700 I think its a great buy. I have a 3080 and have considered getting a used 3090 as well
What kind of GPU temps are you hitting on your 3090 while ... - Reddit
Apr 3, 2022 · My 3090 ftw ultra doesn’t throttle until it hits 94c at gaming on max settings in hitting 86-92c been like this for over a year and card has been running fine. If temps are an issue you can …