What does “good enough” mean here though? At the moment I highly doubt that we’ll get anywhere near the performance of frontier models on hardware accessible to the average user, due to the limitations of physics itself. Then on the model side of things I think there’s probably a limit on how small we can go before accuracy becomes a major issue, and I don’t think that limit would be something that consumer hardware would be able to run (and by consumer hardware I mean your average sub $1000 gaming PC, not bleeding edge M6 Macs)
What does “good enough” mean here though? At the moment I highly doubt that we’ll get anywhere near the performance of frontier models on hardware accessible to the average user, due to the limitations of physics itself. Then on the model side of things I think there’s probably a limit on how small we can go before accuracy becomes a major issue, and I don’t think that limit would be something that consumer hardware would be able to run (and by consumer hardware I mean your average sub $1000 gaming PC, not bleeding edge M6 Macs)