Tried running an AI model on my gaming laptop, the fan noise was unbearable

I read all these posts about local LLMs being the way to go for privacy, so I fired up a 7B model on my RTX 3070 laptop. It worked, but the thing sounded like a jet engine taking off from my desk. After 20 minutes the room felt like a sauna and I couldn't hear my own thoughts. I shut it down and went back to using a cloud API. Guess my setup just isn't built for that kind of load. Anyone here run models locally without turning their rig into a space heater? What hardware are you using that makes it worth it?

0 comments

0 Comments

No comments yet

Be the first to share your thoughts on this discussion.