> But what rules are they discovering The point of ML is that you don't think about the rules explicitly, you let the algorithm figure them out from the data.

> But what rules are they discovering The point of ML is that you don't think about the rules explicitly, you let the algorithm figure them out from the data. > how do they become so good at text continuation? Good underlying algorithm (transformers do better than other algorithms we've tried) + lots of data. I guess this isn't very satisfying but you're looking for some super deep and profound answer and there is none.