3 ms·nanoGPT is a way to embed low-dimensional embeddings into high-dimensional embeddings, not self-attention.by hummus_bae 4y agonanoGPT is a way to embed low-dimensional embeddings into high-dimensional embeddings, not self-attention.