3 ms·
The underlying mechanics are unimportant. You could make similar arguments about encryption and compression algorithms.
by pesfandiar 3y ago
The underlying mechanics are unimportant. You could make similar arguments about encryption and compression algorithms.
- whitfieldsdad 3y agoI don't follow, don't encryption and compression algorithms carry out a very specific steps that isn't likely to show up accidentally by happenstance? (e.g. it'd be hard to accidentally invent Rijndael with nothing but next best token predictions, but might be possible to duplicate someone's code for inverting a binary tree or encrypting a file)
- hiq 3y agoYou can consider your best token predictor as a lossy compression of the corpus it was trained on.