3 ms·
Great point, we are working on an MCP server implementation which should address this. The main benefit of having a serving engine here is to abstract away brow
by calebhwin 1y ago
Great point, we are working on an MCP server implementation which should address this. The main benefit of having a serving engine here is to abstract away browser-LLM specific optimizations like parallelism, caching, browser memory management, etc. It's closer to vllm but I agree an MCP server implementation will make integration easier.
Though ultimately I think the web needs something better than MCP and we're actively working on that as well.
- barbazoo 1y agoLooking forward to hearing more about that MCP successor you’re working on.