4 ms·
I was very surprised how well it did mimicking the StackOverflow archives when I trained GPT-2 on them last year: https://stackroboflow.com https://stackroboflo
by yeldarb 6y ago
I was very surprised how well it did mimicking the StackOverflow archives when I trained GPT-2 on them last year: https://stackroboflow.com https://stackroboflow.com (Only the 345M weights were released back then; now I'm curious how much better 1.5B would do.)