- You can develop a very deep understanding of a sequence by observing how each element interacts with each other over many sequences. - This understanding can

- You can develop a very deep understanding of a sequence by observing how each element interacts with each other over many sequences. - This understanding can be encapsulated in "compressed" low dimensional vector representation of a sequences. - You can use this understanding for many different downstream tasks, especially predicting the next item in a sequence. - This approach scales really well with lots of GPUs and data and is super applicable to generating text.