3 ms·
Interesting research, but I wish people would stick to the clearer term “inference-time computation” instead of the more ambiguous and confusing “test-time comp
by mentalgear 1y ago
Interesting research, but I wish people would stick to the clearer term “inference-time computation” instead of the more ambiguous and confusing “test-time computation.”
- adastra22 1y agoLiterally everything you do during inference is inference-time, no?
- falcor84 1y agoWell, if all you're doing is accessing stuff that was pre-learned earlier, then it's not quite inference-time.
- deleted 1y ago[deleted]
- bonoboTP 1y agoTest/evaluation/inference are treated as almost synonymous because in academic research you almost exclusively run inference on a trained model in order to evaluate its performance on a test set. Of course in the real world, you will want to run inference in production to do useful work. But the language comes from research.