From the paper [1]: > For each of the 517 SO questions, the first two authors manually used the SO question's title, body, and tags to form one question prompt

From the paper [1]: > For each of the 517 SO questions, the first two authors manually used the SO question's title, body, and tags to form one question prompt and fed that to the Chat Interface of ChatGPT. The generated answers by ChatGPT are then stored in CSV files. For the additional 2000 SO questions, ChatGPT 3.5 Turbo API is used. I would be interested in seeing the results for GPT-4. For a paper released in August 2023, it’s strange that GPT-4 isn’t even mentioned. [1] https://arxiv.org/abs/2308.02312 https://arxiv.org/abs/2308.02312