3 ms·
That is my question too. Is it a fancier autocomplete? Or does it reason about code?
by iamcurious 5y ago
That is my question too. Is it a fancier autocomplete? Or does it reason about code?
- robbedpeter 5y agoIt reasons over the semantic network between tokens, in a feedforward inference pass over the 2k(ish) words or tokens of the prompt. Sometimes that reasoning is superficial and amounts to probabilistic linear relationships, but it can go deeply abstract depending on training material, runtime/inference parameters, and context of the prompt.
- PeterisP 5y agoIn some sense you could think of as a fancy autocomplete which uses not only code but also comments as input, looks up previous solutions for the same problem but (mostly) appropriately replaces the variable names to those that you are using.