3 ms·
Can one argue that the random initialization of a model is akin to this starting point? A human brain has reached a morphogenetic starting point thanks to much
by dpflan 4y ago
Can one argue that the random initialization of a model is akin to this starting point? A human brain has reached a morphogenetic starting point thanks to much evolution, a process full of randomness.
- jstx1 4y ago> Can one argue that the random initialization of a model is akin to this starting point? It's a starting point but it's random, unlike the starting point of a human being which is very very not random.
- dpflan 4y agoAll right, let’s dig deeper, I like your responsiveness. Imagine if the LLM were randomly provided the same starting point as human brain…what happens? Is evolution a differentiable process?