3 ms·
It's just concept space. The entire LLM works in this space once the embedding layer is done. It's not really that novel at all.
by danielmarkbruce 2y ago
It's just concept space. The entire LLM works in this space once the embedding layer is done. It's not really that novel at all.
- ttul 2y agoThis was my thought. Literally everything inside a neural network is a “latent space”. Straight from the embeddings that you use to map categorical features in the first layer. Latent space is where the magic literally happens.
- madethisnow 2y agoCompletely agree. Have you see this? https://sakana.ai/asal/ https://sakana.ai/asal/