2 ms·It has to be 2^n nodes and limited to one per attention head that the model has.by reilly3000 1y agoIt has to be 2^n nodes and limited to one per attention head that the model has.