I’ve been digging into the rabbit hole for a few months. Been switching to Linux, FOSS everything I can, trying to go to smaller sites, the least dubious social media, VPN, trusted mail, etc etc
But lately I’ve been in a rough state mentally (I say lately but it’s always been with me) and having GPT guide me and being able to just dictate what I think helps me a lot on various levels, for various reasons.
But at this point, using ChatGPT with a mic, isn’t this basically cancelling every effort I’ve made? (using it in the first place anyway)
I’m weak and it helps me, should I just throw my efforts out of the window and just say I don’t care about privacy anymore and use whatever everyone uses? (on one hand, I’ve found alternatives for almost everything, so I could keep on using those, but also, again, if I keep on using GPT on a regular basis, this is probably the worst threat the future has to offer in termes of privacy, so…I’m lost)
Spend $500, buy a beefy used GPU and run Whisper + Mistral small. It’ll be a bit slow but now you can maintain your privacy on your own hardware! Best of both worlds.
Look for GPUs with more memory. My choice is the AMD 7900 XTX with 24Gb.
Scalpers made it expensive though
Yeah unfortunately ROCM is shit last I heard
Why?