2 ms·At small input size, yes the MLP dominates compute. At large input attention matters moreby brrrrrm 2y agoAt small input size, yes the MLP dominates compute. At large input attention matters more