Tiny models that you can just run locally sound pretty sweet. I can see a lot of privacy‑minded folks liking this since you don’t have to phone home to an API for every request. Curious how big the trade‑off is between size and accuracy once you get beyond simple classification tasks, I see you can "bring your own data" too instead of just throwing a bunch of synthetic stuff at it.... I wonder how well that works.
Tiny models that you can just run locally sound pretty sweet. I can see a lot of privacy‑minded folks liking this since you don’t have to phone home to an API for every request. Curious how big the trade‑off is between size and accuracy once you get beyond simple classification tasks, I see you can "bring your own data" too instead of just throwing a bunch of synthetic stuff at it.... I wonder how well that works.