cross-posted from: https://piefed.world/c/tech/p/1460036/just-say-no-to-openai-and-anthropic
You must log in or register to comment.
6 daysI’m also impressed with GLM-5.3-Flash. This is similar to Claude Opus 4.8. It’s much smaller and cheaper than GLM-5.3, and still incredibly capable. It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
512 GB of RAM?!
My brother in christ I don’t even have 12 GB of ram! I don’t even have 512GB of SSD storage!
It looks like one can’t get a 512GB Mac Studio until the end of the month, so right now, nobody does.
- zebidiah@lemmy.caEnglish5 days
I’ve preferred Chinese alternatives since they became available. Fuck clammy Sam Altman and Wario, and I don’t really give a shit otf the Chinese know I can’t write my own yaml
The tech is legitimately cool, but American AI CEOs are unbearable cunts that only make hype
It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
From the article.
Apple announced the M5 Ultra Mac Studio on August 26, 2026, with pre-orders open today and shipping on September 22. The headline number for local AI is 512GB of unified memory at 1.2 TB/s of memory bandwidth, starting at $5,499.
https://modelfit.io/blog/mac-studio-m5-ultra-512gb-local-llm/
Can’t find any for sale, because it seems completely unavailable at the moment. That aside, I wouldn’t call a price point of $5500 USD ‘feasible’.
- wintermute@discuss.tchncs.deEnglish5 days
I’m pretty sure it has to be way more than $5500 for the 512GB model. By boss bought a couple (older models) to run local inference at work, and he paid like $20K each.
- zebidiah@lemmy.caEnglish5 days
Ehhh if it’s a hobby you’re really into it’s not a crazy amount, I spent way more than that on motorcycles just for shits and giggles, 5k of photography equipment is a pretty small and sad pile, same with hi-fi, fishing, watches, bicycles etc.
- zebidiah@lemmy.caEnglish5 days
Find used 16gb GPUs off your local marketplace, Jensen (and by extension, Jenson’s leather jacket) don’t make shit on the used market
