Loading…
2
Rant: the maker fair in San Jose talked me out of cloud AI and back into local models
I went to the Maker Faire in San Jose 6 months ago expecting to see cloud tools everywhere, but a guy running a Raspberry Pi cluster demo showed me an 8 billion param model answering his questions in under 40 lines of code with zero internet. I had been paying $45 a month for API access I barely used, and standing there I finally got why a small local model beats a giant cloud one for what I actually do. Who else here has moved off hosted APIs for their side projects, and what made you switch?
1 comments
Log in to join the discussion
Log In1 Comment
pat_stone15d ago
Reminds me of when I built a little weather box with a Pi and realized I didn't need any fancy service to do what I wanted. Something about watching that thing just work offline made the cloud stuff feel silly.
4