Hi Guys
Been looking into building a localLLM box to run at home to do things like ingest emails and monitor various communications then create events, reminders and tasks for me. I’d also like to explore communicating with the system via realtime voice chat (I don’t expect it to be real real time, a short delay is fine if I can communicate with natural language). If this isn’t feasible for the home player, please stop me now.
I will not be doing any coding or am happy to pay for a few tokens on a frontier model if I need deep reasoning.
Obviously during the research phase I am just as susceptible to budget creep as anyone else but seeing as I have no VC investors I can’t just thow blackwell cards at the problem.
Prices are even worse here in Australia than the rest of the world but I can afford a new 5060 16gb with a second hand mobo/cpu and 32gb of ddr4 ram if needed (appox $1700 aud),
but I could save $600 by getting a second hand 3060 12gb and dropping to 16gb ddr4. I have no spare hardware to build any system out of so kinda want to get this reasonably right the first time.
TLDR; Is a 3060 12gb and 16gb DDR4 going to be enough to run realtime voice and a smallish personal assistant? How many cores should I look for in a CPU? Am I on a wild goose chase?
submitted by /u/Thebandroid
[link] [comments]
Originally published at reddit.com. Curated by AI Maestro.
Stay ahead of AI. Get the most important stories delivered to your inbox — no spam, no noise.
