Loading…
3
Picked a free local model over a cloud one for my home project, honestly shocked at how close it got
I had to choose between running a small model on my own PC or paying for API calls to build a little tool that sorts my saved recipes. Went with the local one after a buddy said his electric bill only went up about $4 a month, and it labels everything right maybe 8 out of 10 times. Curious if anyone here has compared the two for basic text stuff and stuck with one over the other.
1 comments
Log in to join the discussion
Log In1 Comment
the_holly3d ago
That $4 a month hit is the part that gets me. I ran a 7B model on my old gaming rig for a few weeks just to tag and sort my bookmarks, and the power draw was so small I stopped even thinking about it. Cloud APIs look cheap until you actually add up a few thousand calls, then it's suddenly $15 or $20 you didn't plan for. Your 8 out of 10 hit rate lines up with what I saw too, good enough for sorting stuff where a wrong label is just mildly annoying. For anything where I need it near perfect I'd still pay for the API, but for a personal tool like recipes? Local all the way.
4