Cool blog, thanks! I did a similar project a couple of years ago for a university course, only I also added style transfer, it turned out pretty cool. I scrape

Cool blog, thanks! I did a similar project a couple of years ago for a university course, only I also added style transfer, it turned out pretty cool. I scraped a bunch of news data together with it's news section and trained a self attention language model from scratch, turned out pretty hilarious. Data was in Hebrew, which is a challenge to tokenize because of the morphology. I posted it on ArXiV if someone's interested in the style transfer and tokenization process: https://arxiv.org/abs/2212.03019 https://arxiv.org/abs/2212.03019