It would be so cool if we knew how many FLOPs of compute a single token string response is, and whether that number for compute effort can be increased or decre

It would be so cool if we knew how many FLOPs of compute a single token string response is, and whether that number for compute effort can be increased or decreased by orders of magnitude to save cost/time or improve output using the same model.