3 ms·
There's potentially some interesting research potential there given that you can peak more behind the scenes to infer how different inputs result in different o
by dontupvoteme 3y ago
There's potentially some interesting research potential there given that you can peak more behind the scenes to infer how different inputs result in different outputs without the black box of RLHF at play.
For instance, if I want to generate some python code that uses a certain library and use the "write the code header + function def + docstring" approach with complete/insert/edit functionality how does the output change if
0. I vary the file header
1. I vary the presence of other functions in the input
2. I larp as the creator of the lib, a famous programmer, John Smith, Hans Mueller, Ivan Ivanovich Ivanovsky
3. (In combination with 2) - I prompt it in another language
4. I choose GPL vs BSD vs Apache vs other licenses
5. I specify exact python and module versions (right now it hallucinates functions which I don't have a lot, which is quite annoying)
It was trained on code and I don't like being abstracted away from code itself if I can avoid it/
I don't know how long davinci will be around as it strikes me as a risk to openAI - it may be being datamined as we speak for use in a legal case against them in the future, e.g. to show more direct evidence of having trained on data which they shouldn't have.
Practically speaking I will sometimes run a request in parallel between davinci, chat API and the web interface and compare the results.
- deleted 3y ago[deleted]