4 ms·
> The biggest issue I see is that those models (or rather their trained parameters) are usually pretty large (several GiB). So it'll take a while to set up in t
by capableweb 4y ago
> The biggest issue I see is that those models (or rather their trained parameters) are usually pretty large (several GiB). So it'll take a while to set up in the browser before the evaluation can actually start. It'll also require a lot of bandwidth on both ends.
Might not be feasible due to memory constraints (I'm not sure), but browsers can load data from disk into memory without having to touch the network. So you could in theory ask the users to download the model separately, then ask them to select it from a file picker, and the browser can have access to it that way.
- flyteuk 4y agoIt'd be nice if the models could be loaded via WebTorrent[1], which would significantly reduce the bandwidth requirement for whomever releases it. [1] https://github.com/webtorrent/webtorrent https://github.com/webtorrent/webtorrent
- tough 4y agoThe models are certainly available on torrent though
- lmeyerov 4y agoNext step: browser JS VMs need to allow you access gigs of RAM in-memory, it's surprisingly locked down
- jakogut 4y agoRight. Another option is running the model locally from a web page, served from the project source directory, which is still a lot easier than setting up a platform specific GPU accelerated ML dev environment.