Page 1
Page 1
Started By
Message

Anyone know where to get Nvidia GPUs?

Posted on 4/23/25 at 3:50 pm
Posted by Dallaswho
Texas
Member since Dec 2023
2446 posts
Posted on 4/23/25 at 3:50 pm
I’m looking to build a better ai model and the new 5060ti 16gb looks perfect. I can’t find it anywhere near MSRP though. Is there a secret? Do I have to camp all night before a shipment or something?
Posted by LEASTBAY
Member since Aug 2007
15633 posts
Posted on 4/23/25 at 4:04 pm to
Near impossible to find it seems. I look every now and then. Maybe look for similar ones also.
5070
Posted by SlackMaster
Baton Rouge
Member since Jan 2009
2778 posts
Posted on 4/23/25 at 4:46 pm to
Radio Shack
Posted by Dallaswho
Texas
Member since Dec 2023
2446 posts
Posted on 4/23/25 at 4:48 pm to
quote:

Near impossible to find it seems. I look every now and then. Maybe look for similar ones also. 5070

Thanks. I’ve seen a 5070 near msrp or 550 or whatever. It would be 50% faster but at 12gb, probably fill up vram even after controlling context size and quantizing km cache and everything else. I can wait, I have a 3050 6G now and it is zippy enough with a 4b q4km gemma3 but context cache can get it pretty full. I’d just like it to be a little bit smarter so maybe it can pass on the correct queries more often and answer questions correctly.
Posted by Joshjrn
Baton Rouge
Member since Dec 2008
29856 posts
Posted on 4/23/25 at 5:16 pm to
Nothing worth buying for AI is easily attainable right now. If you want one that badly, join a handful of restock Discord channels and stay on it. Otherwise, just wait a few more months and things should level out.
Posted by bluebarracuda
Member since Oct 2011
18832 posts
Posted on 4/23/25 at 8:26 pm to
I was going to say get a Tesla p40 but holy shite have those shot up in price
Posted by LSshoe
Burrowing through a pile o MikePoop
Member since Jan 2008
4295 posts
Posted on 4/24/25 at 1:57 pm to
quote:

just wait a few more months and things should level out.


I feel like this has been the GPU mantra for about a decade. It used to be crypto miners and now its AI Scooping up all the GPUs
Posted by Joshjrn
Baton Rouge
Member since Dec 2008
29856 posts
Posted on 4/24/25 at 2:00 pm to
quote:

I feel like this has been the GPU mantra for about a decade. It used to be crypto miners and now its AI Scooping up all the GPUs

For the first few months after a release, yeah, pretty much. The Nvidia 30 series release is the only one I can think of that truly broke the market. GPUs were still hard to get at msrp for about a year after release.
Posted by Dallaswho
Texas
Member since Dec 2023
2446 posts
Posted on 4/24/25 at 2:55 pm to
I don’t mind forking out the $$ but don’t want to get ripped off. I found the 5060ti 16g for 479(only $50 over) on Best Buy in some online queue but then saw it had a janky physical x8 interface. I get that all mid range cards digitally interface on x8, but who the hell makes the physical interface like that? Might get it anyway or pick a couple old 3060-12gs.
Posted by LSUGent
Member since Jun 2011
2710 posts
Posted on 4/24/25 at 10:24 pm to
If you are interested in AI application stuff you’re better off looking for second hand 3090s. 24gb of VRAM vs 16 makes it a lot more attractive.
Posted by Dallaswho
Texas
Member since Dec 2023
2446 posts
Posted on 4/25/25 at 7:31 am to
3090/5090 would certainly scale way better as MBW won’t scale when cards are “taking turns” but I only need inference and everything I want to do “real time” is low token, just calling DB and QA. I’m already getting correct calls with a tiny vision model(obviously wrong choice) but only 25% of the time or worse. My 24/7 higher context stuff doesn’t have to be fast and is mostly analyzing/compiling data that is already delayed anyway. Also has to fit in an old precision 7810.
I guess my criteria are: GB/$, >12GB/slot, then MBW/GB/slot.
So.. 5060ti-16, 3060-12, p40-24, 4060ti-16, and maybe something I’m missing.
first pageprev pagePage 1 of 1Next pagelast page
refresh

Back to top
logoFollow TigerDroppings for LSU Football News
Follow us on X, Facebook and Instagram to get the latest updates on LSU Football and Recruiting.

FacebookXInstagram