3 ms·

Seems like GPT4 via the API is even less nerfed (my impression). More expensive though, obivously. Does make me wonder how much of it's training and how much o

by flir 3y ago

Seems like GPT4 via the API is even less nerfed (my impression). More expensive though, obivously. Does make me wonder how much of it's training and how much of it is throwing less compute at the answer.

zingelshuher 3y ago
> Seems like GPT4 via the API is even less nerfed (my impression). More expensive though, obivously. Not that obvious. If I remember correctly the last model they were still testing was $10/1M_tokens input $30/1M_tokens output. 1M is about all Harry Potter books. ChatGPT Pro is $20/month. Do you really type in one Harry Potter book every month? It took ms. Rowling about a year, she is professional, you know. For heavy users GPT Pro may be cheaper, but for most API is a good option. Not as convenient, and long dialogs may add up. It costs nothing if not used.
- ceinewydd 3y ago
  [dead]
- flir 3y ago
  Very very interesting, I confess I hadn't done the maths. I think throwing a large context window back and forth might add up quite quickly, but it's worth setting up my own interface over the API (I'm just using `mods` right now) just to see what my real-world usage looks like.