3 ms·
Does it do inter-frame compression at all? Also, integrating with Ollama.ai or some other local LLM with an API server would be fantastic.
by pmarreck 3y ago
Does it do inter-frame compression at all?
Also, integrating with Ollama.ai or some other local LLM with an API server would be fantastic.
- jasonjmcghee 3y agoI’d love your opinion on the right way to do this! Being able to call APIs means network permissions- which i was trying to avoid. Maybe via Stdin / Stdout?
- pmarreck 3y agowere you trying to avoid network permissions (I'm guessing) because this is Docker? (That's the only reason off the top of my head for wanting to avoid network access... in a non-Docker context, localhost is of course easy to hit up, but Docker and nets are a PITA)
- bwghughes-fth 3y agoJason - great work here. Your Swift code looks like mine :) on this, some folks in the UK have created Crux - an interesting abstraction layer for mobile apps using Rust. Might provide some ideas for optimisation/ipc. https://github.com/redbadger/crux https://github.com/redbadger/crux