3 ms·
I wonder if it will make sense to have a central natural language parser of sorts managed by the OS that includes a model like this? So all command line progra
by matchaonmuffins 5mo ago
I wonder if it will make sense to have a central natural language parser of sorts managed by the OS that includes a model like this?
So all command line programs can hook into this model at runtime, and you can have adaptors for fine-tuning etc.
- ilaksh 5mo agoYes I assume some kind of LLM system will eventually make its way into OS package registries and eventually there will be a standard of some sort. Already OpenAI's API is the de facto standard available from all providers. But who knows what port it's on. Maybe implement mDNS/DNS-SD or SSDP, and if not there it could just go through default ports like the Ollama one and check for a certain endpoint.
- ainch 5mo agoApple already have this working on iOS - as discussed in this recent post. https://unix.foo/posts/local-ai-needs-to-be-norm/ https://unix.foo/posts/local-ai-needs-to-be-norm/