3 ms·
Any plans to support Windows? That would make Carton the ultimate library to embed LLMs into desktop applications
by civilitty 3y ago
Any plans to support Windows? That would make Carton the ultimate library to embed LLMs into desktop applications
- vpanyam 3y agoI'm definitely open to it if there's interest (or if someone wants to help), but I don't have plans to implement Windows support myself at the moment. The currently supported platforms [1] were mostly driven by environments I've seen at various tech companies. I do have active plans to support inference from WASM/WebGPU so maybe that could be a good entrypoint to Windows support. -- [1] Currently, the supported platforms are: * `x86_64` Linux and macOS * `aarch64` Linux (e.g. Linux on AWS Graviton) * `aarch64` macOS (e.g. M1 and M2 Apple Silicon chips) * WebAssembly (metadata access only for now, but WebGPU runners are coming soon)