4 ms·
It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.
by osmarks 5y ago
It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.
- pitched 5y agoThat thought was why I added “almost” right before posting! It’s free to run, just, except for the expensive parts... AWS still rents out GPU power, right? That might be a bit easier to get started with.
- osmarks 5y agoYou can rent GPUs from various cloud providers, but those are hilariously expensive too even given datacentre GPU prices.
- hrfbi 5y agoHottest take in the history of mankind. I think my screen is about to melt. GNU/Linux is not free, it requires a computer to run. Free beer is not free, drinking it requires you to pay for your upkeep to remain alive to be able to drink it.
- bluesnowmonkey 5y agoThe comment to which you replied is making a useful point actually. Self hosting is not free in the relevant sense when comparing cost vs a third party API.
- osmarks 5y agoGNU/Linux requires basically the same hardware as the usual alternative (Windows). If you switch from hosted GPT-3 to selfhosted GPT-J you start needing to get and manage all the hardware, which might go underutilized most of the time depending on what your demand looks like, and which requires lots of software optimizations to use maximally effectively. You can use hosted GPT-J, though, a few companies offer that.