Hah, ok, yeah except for small org + tiny models no ML team is training on laptops. On the other hand I think we're already seeing more app devs using language

Hah, ok, yeah except for small org + tiny models no ML team is training on laptops. On the other hand I think we're already seeing more app devs using language models while not doing any training at all, and those people will probably want to work on their laptops. Think code completion, OCR / data extraction, image processing, or even as a local stand-in for cloud APIs similar to how SQLite is used as a database stand-in. In that sense local inference is pretty important.