3 ms·
But I'd say LLMs produce content faster than I can read or write it, because they can produce content which is really dense. Ask GPT-4 a question and then answ
by armchairhacker 3y ago
But I'd say LLMs produce content faster than I can read or write it, because they can produce content which is really dense.
Ask GPT-4 a question and then answer it yourself. Maybe your answer will be as good or better than GPT-4's but GPT-4 writes its answer a lot faster.
- furyofantares 3y agoIt certainly doesn't produce content as fast as I can read it.
- renonce 3y agoOnly if you use gpt-4. gpt-3.5-turbo is much faster, and gpt-4 is only going to get faster as GPUs get faster.
- cubefox 3y agoBing also uses GPT-4 and it is very fast. Microsoft spends more ok compute.
- furyofantares 3y agoIt doesn't exclusively use GPT-4, you might be right anyway that their GPT-4 is much faster but you're also not always seeing GPT-4 with them.
- cubefox 3y agoI'm pretty sure it at least mostly uses GPT-4.
- darknoon 3y agoafaict OpenAI's instance is massively overloaded, you can see with the 32k context model actually being faster in practice rather than slower
- furyofantares 3y agoYep. I use GPT-4 extensively and exclusively, and the comment I was replying to mentioned GPT-4. I can't wait for it to get faster.
- bombolo 3y agodense content? Not in my experience. It seems to be really overly verbose for me.
- Tostino 3y agoPrompt it to be information dense in its response then.