While that's true, a small piece of code can likely be JITed once and then will essentially become cached. I'm guessing that real world applications will have

While that's true, a small piece of code can likely be JITed once and then will essentially become cached. I'm guessing that real world applications will have more overhead from JITing thus the performance likely won't be quite as good. Still, even if performance increased by 2x - 3.5x or so that would be a huge win.