Interesting take. I feel in this discussion, many people are approaching it from the theoretical limitations of LLMs, and you seem the only one taking the exper

Interesting take. I feel in this discussion, many people are approaching it from the theoretical limitations of LLMs, and you seem the only one taking the experimental approach. Funny enough, many who doubted LLMs capabilities 4 years ago, have come around their emergent capabilities, yet with much skepticism, simply because we still don't understand how these emergent abilties work. I haven't seen a paper comparing the threshold of performance with the LLMs increased capabilities, and what parameter (and their weights) come into play to influence the performance.