4 ms·
I'm still betting on words, because we can rebuild with those. At the same time, accepting weights doesn't have to mean surrendering attention, literacy, and cr
by turtleyacht 3y ago
I'm still betting on words, because we can rebuild with those. At the same time, accepting weights doesn't have to mean surrendering attention, literacy, and critical thinking.
Always invest (time) in first principles, at any rate.
- quantified 3y agoWords are our serialization protocol. It's always been the weights. We have other serialization protocols too (facial expressions, gestures/body language, and pheromones). Our world models are structures of weights. Brains (not just human) are built to optimize for certain kinds of weightings. But we can't just transmit weights. Each brain and each training set in the form of life experiences and inner conversation is unique. Words have the greatest dynamic range of expressiveness. So words (written in the form of sentences, paragraphs, etc, spoken in many ways) will still be key.