3 ms·
Does that definition hold if the power use of the system is a multiple of what a human would use for the same task?
by amelius 3y ago
Does that definition hold if the power use of the system is a multiple of what a human would use for the same task?
- rational_indian 3y agoPower used is important but so is speed. For example right now I am sure the GPT cluster consumes power in the order of megawatts but you have to remember it serves thousands of users simultaneously.
- amelius 3y agoYes, so energy use per task. I thought that was clear.
- rational_indian 3y agoOptimizing energy use per task at will be a waste of time at this point of time, this will come later. The metric used by OpenAI seems to be more useful right now.