4 ms·
This is how I learned (approximately) how GPT-2 worked. Start with GPT-2 and it's full of nonsense you don't understand. Follow the references, follow more refe
by immibis 5y ago
This is how I learned (approximately) how GPT-2 worked. Start with GPT-2 and it's full of nonsense you don't understand. Follow the references, follow more references. Get to basic neural networks with one hidden layer like you learned about in college. Reverse the chain and build upwards.