4 ms·
Also unclear if he's sampling at temp=0. Looks like he doesn't set a temp? https://github.com/adamkdean/gpt-unicorn/blob/8ad76ec7161682af531f0b23ab14f4fdbfaf41f
by gwern 4y ago
Also unclear if he's sampling at temp=0. Looks like he doesn't set a temp? https://github.com/adamkdean/gpt-unicorn/blob/8ad76ec7161682af531f0b23ab14f4fdbfaf41f5/src/lib/chatapi.js#L7 https://github.com/adamkdean/gpt-unicorn/blob/8ad76ec7161682... So not sure what he's really doing.
- capableweb 4y agoThen it's using the default value which is temperature=1.0, which is by no way deterministic (not that temperature=0.0 is either, but it's more likely to give similar responses to similar prompts, than 1.0 is)