3 ms·
It's easier to keep doing something incremental than to fundamentally change things. One avenue these phone OS, and any consumer OS, can pursue is making it ea
by pradn 1y ago
It's easier to keep doing something incremental than to fundamentally change things.
One avenue these phone OS, and any consumer OS, can pursue is making it easy to string together app sub-steps. An app can be "cracked open" into sub-step a) either by developers themselves b) or by a backend process at app submission time. The backend process could look at the screens, and see what the user journeys are - this is within reach for current LLMs. An "sub-step" here is like taking a flights app and turning it into different types of search functions - search by date, location, points etc. So an app becomes a bunch of interfaces.
Once you have these "sub-steps" a local LLM can string them together, because it can understand their inputs, outputs, and behaviors.
Actually executing the sub-steps would require the OS to execute the app in the background and run the sub-steps for the user. This would be akin to what browser agents do right now
So this is a way of semantically extracting the "verbs" in existing apps.
With a library of these "sub-steps" in apps, combined with similar ones extracted from the internet - you could chain together the web and native worlds, in the service of the user.
It's easier on phone OSs because phone apps are usually already logged in. It's realistic for iOS to just do a bunch of stuff for you in the background. You really can probably get finance info from all your finance apps, for example.
I'm not saying this is necessarily the answer - but re-thinking the OS in this sort of what is what would be an actually ambitious thing for Apple or Google to do. All these small tweaks are opiates.
- thecupisblue 1y agoThis is already supported by intent system on Android and partially by the new intents in iOS. It is now up to developers to expose this.