Gauging state of the art against what is available for free or for very cheap per token cost is like gauging the maximum theoretical transport potential by ridi

Gauging state of the art against what is available for free or for very cheap per token cost is like gauging the maximum theoretical transport potential by riding a bicycle. You’re using something that is very energy efficient; you cannot extrapolate that experience to conclude that SOTA models are not doing something much different.