2 ms·It's the multi-head attention that you're seeing in action. ChatGPT has 12, GPT-3 has 96.by politician 4y agoIt's the multi-head attention that you're seeing in action. ChatGPT has 12, GPT-3 has 96.