5 ms·
But processing hardware has been seeing diminishing returns for years. My CPU from 2013 is still doing what I need; a 1993 processor in 2003 would have been use
by flangola7 4y ago
But processing hardware has been seeing diminishing returns for years. My CPU from 2013 is still doing what I need; a 1993 processor in 2003 would have been useless.
Where do you see hardware improvements coming from?
- stormfather 4y agoSpecifically in AI there is huge room for improvement with things like optical computing. AI processing doesn't need to be completely deterministic, as shown by the fact that we are quantizing llama down to 4 bit without too much of a drop in performance. Once you drop that requirement you open the door to using much, much more efficient analog circuits. How do I invest in optical computing...
- ChatGTP 4y agoCan’t ChatGPT design better hardware ?
- sebzim4500 4y agoNo but maybe GPT-5 will be able to
- deleted 4y ago[deleted]
- Xorakios 4y agoOnly Deep Thought can do that. And the answer is still 42.
- ChatGTP 4y agoGood to know!
- Karrot_Kream 4y agoTraining these nets mostly occurs on GPUs. CPUs are often hamstrung by their serial performance (e.g. operations that depend on the output of a previous operation end up stalling instruction pipelines.) GPUs still have a decent amount of room to parallelize and maximize compute.