F
15

I read that some AI models now use less power than a light bulb for a full day of work

I was looking at a report from a tech lab in Austin last week about how efficient new chips are getting. The paper said one specific model, called a 'tiny language model', can run complex tasks for 24 hours on about 10 watts. That's less power than my old desk lamp uses. It's wild to think about how much the energy side of this stuff has changed. Has anyone else seen numbers like that on newer systems?
4 comments

Log in to join the discussion

Log In
4 Comments
jamie_adams
That's way more efficient than my old laptop.
7
davidkim
davidkim2mo ago
Tell me about it. My last one sounded like a jet engine just opening a browser tab. I was basically using it as a space heater. The new ones are so quiet it feels like I'm getting away with something.
6
leehall
leehall2mo ago
Those new chips are a total game changer. My old setup was exactly what @davidkim described, a loud heater on my desk. The shift to efficient hardware means you can actually leave things running without worrying about your power bill. It makes local AI tools way more practical for everyday use. The tech is finally catching up to the promise of being useful and quiet.
3
murphy.tessa
murphy.tessa1mo agoMost Upvoted
It's crazy how fast this is moving. My old desktop was basically a personal heater too, just like leehall said. The new gear is so quiet and cool you forget it's even on while it's working. Makes you wonder what they'll manage to shrink down next, right?
3