5 ms·
The optimization does not affect the result of LLM, it's guaranteed to produce equivalent results as decoding directly. Let's not treat that LLM as some magic t
by renonce 2y ago
The optimization does not affect the result of LLM, it's guaranteed to produce equivalent results as decoding directly. Let's not treat that LLM as some magic that resembles our mind, it's just another program that produces sentences that happens to make sense.
- sigmoid10 2y agoLets not treat our mind as something magical. It's just another program that learned to speak by consuming lots of training input. The implementation might look slightly different from the outside, but from a mathematical perspective, artificial neural networks are proven to be at least as capable as the human mind.
- baq 2y agoThe best part is, your comment works both when sarcastic and completely serious.
- ben-schaaf 2y ago> artificial neural networks are proven to be at least as capable as the human mind Do you have a source for this? I know we have models of neural networks designed to act like neurons, but those aren't what're being used.
- sigmoid10 2y agoSee the universal approximation theorem for fully connected perceptrons.
- ben-schaaf 2y agoThat's really nowhere near enough of a proof. You'd need to prove that a human brain is equivalent to a mathematical function, and that that function can be sufficiently approximated by a NN to be functionally identical. Additionally UAT doesn't actually prove NNs can approximate any function. Non-continuous functions and infinitely large domains aren't covered.
- xpe 2y agoDefine ‘capable’ and most of the confusion and potential controversy goes away.
- wangii 2y agoAccording to the original Jacobi decoding paper, it's set in the machine translation tasks, with encoder + decoder, in which parallel algo applied only to the decoder part.
- naasking 2y ago> Let's not treat that LLM as some magic that resembles our mind,it's just another program that produces sentences that happens to make sense. "That happen to make sense" is hiding a lot of magic. It would be statistically impossible to make as much sense as LLMs do in response to prompts if it did not actually make semantic distinctions. If it makes semantic distinctions, then it does resemble the human mind in at least one way.