I hope this post is allowed, I feel if benefit not only me but more people.
Which model you’d recommend for non-coding questions?
- If I have 48GB of unified memory (MacBook Pro M5) which is a good model I can ask questions about China, socialism and similar from a “comrade” framing?
- Which models you’d recommend in different bands?
- If I wanted to improve my setup (build a better rig to run better local models) what are my options?
- How can I tune the models I’m using?
In the last 6 months I started to use more AI tools because of (I was actually pressured by) work. I’m becoming better at using it as a tool in my day to day life and it has helped to take steps to delete my digital footprint, improve my privacy settings and limit my dependance on “search engines”.
I’m building a bridge to a raspberry Pi that has a hard drive plugged in, cutting my dependency to services of photos, files and music. This same bridge access this work computer (which I’ll leave plugged in permanently, 48GB of unified memory) and I made it so I can load models through the bridge and ask questions.
Some of the ones I have take too long, eating tokens and sometimes getting stuck in loops; they fill up quickly (run out of memory due to the context?).
Someone here must know: I’m a lurker and you, comrades, are on the edge. I’m also interested in looking for models that provide unfiltered info. You can dm and we can chat. I’m not a fed, you can go check the educational Marxist content I’ve been doing.
Edit: I must add that I’ve been using Claude Code A LOT. I’m aware of the implications and I’d like to take steps to reduce that usage.