- My Forums
- Tiger Rant
- LSU Recruiting
- SEC Rant
- Saints Talk
- Pelicans Talk
- More Sports Board
- Fantasy Sports
- Golf Board
- Soccer Board
- O-T Lounge
- Tech Board
- Home/Garden Board
- Outdoor Board
- Health/Fitness Board
- Movie/TV Board
- Book Board
- Music Board
- Political Talk
- Money Talk
- Fark Board
- Gaming Board
- Travel Board
- Food/Drink Board
- Ticket Exchange
- TD Help Board
Customize My Forums- View All Forums
- Show Left Links
- Topic Sort Options
- Trending Topics
- Recent Topics
- Active Topics
Started By
Message
Anyone know where to get Nvidia GPUs?
Posted on 4/23/25 at 3:50 pm
Posted on 4/23/25 at 3:50 pm
I’m looking to build a better ai model and the new 5060ti 16gb looks perfect. I can’t find it anywhere near MSRP though. Is there a secret? Do I have to camp all night before a shipment or something?
Posted on 4/23/25 at 4:48 pm to LEASTBAY
quote:
Near impossible to find it seems. I look every now and then. Maybe look for similar ones also. 5070
Thanks. I’ve seen a 5070 near msrp or 550 or whatever. It would be 50% faster but at 12gb, probably fill up vram even after controlling context size and quantizing km cache and everything else. I can wait, I have a 3050 6G now and it is zippy enough with a 4b q4km gemma3 but context cache can get it pretty full. I’d just like it to be a little bit smarter so maybe it can pass on the correct queries more often and answer questions correctly.
Posted on 4/23/25 at 5:16 pm to Dallaswho
Nothing worth buying for AI is easily attainable right now. If you want one that badly, join a handful of restock Discord channels and stay on it. Otherwise, just wait a few more months and things should level out.
Posted on 4/23/25 at 8:26 pm to Dallaswho
I was going to say get a Tesla p40 but holy shite have those shot up in price
Posted on 4/24/25 at 1:57 pm to Joshjrn
quote:
just wait a few more months and things should level out.
I feel like this has been the GPU mantra for about a decade. It used to be crypto miners and now its AI Scooping up all the GPUs
Posted on 4/24/25 at 2:00 pm to LSshoe
quote:
I feel like this has been the GPU mantra for about a decade. It used to be crypto miners and now its AI Scooping up all the GPUs
For the first few months after a release, yeah, pretty much. The Nvidia 30 series release is the only one I can think of that truly broke the market. GPUs were still hard to get at msrp for about a year after release.
Posted on 4/24/25 at 2:55 pm to Joshjrn
I don’t mind forking out the $$ but don’t want to get ripped off. I found the 5060ti 16g for 479(only $50 over) on Best Buy in some online queue but then saw it had a janky physical x8 interface. I get that all mid range cards digitally interface on x8, but who the hell makes the physical interface like that? Might get it anyway or pick a couple old 3060-12gs.
Posted on 4/24/25 at 10:24 pm to Dallaswho
If you are interested in AI application stuff you’re better off looking for second hand 3090s. 24gb of VRAM vs 16 makes it a lot more attractive.
Posted on 4/25/25 at 7:31 am to LSUGent
3090/5090 would certainly scale way better as MBW won’t scale when cards are “taking turns” but I only need inference and everything I want to do “real time” is low token, just calling DB and QA. I’m already getting correct calls with a tiny vision model(obviously wrong choice) but only 25% of the time or worse. My 24/7 higher context stuff doesn’t have to be fast and is mostly analyzing/compiling data that is already delayed anyway. Also has to fit in an old precision 7810.
I guess my criteria are: GB/$, >12GB/slot, then MBW/GB/slot.
So.. 5060ti-16, 3060-12, p40-24, 4060ti-16, and maybe something I’m missing.
I guess my criteria are: GB/$, >12GB/slot, then MBW/GB/slot.
So.. 5060ti-16, 3060-12, p40-24, 4060ti-16, and maybe something I’m missing.
Popular
Back to top
