4 ms·
Another consideration here is that hosting a queryable model like this becomes expensive. I remember a couple of years ago lone developer had to take down his s
by fumblebee 4y ago
Another consideration here is that hosting a queryable model like this becomes expensive. I remember a couple of years ago lone developer had to take down his site which hosted a freely accessible version of GPT-2 (3?) model because the bills were running to some $20k. (Chump change for Google, but still).
- Gigachad 4y agoI think a lot of people would be perfectly happy to pay per query to access this.