3 ms·
Prompts missing is a severe minus in terms of reproducibility - and hence how serious I take the paper. I would urgently recommend to the authors to add everyth
by data_maan 2y ago
Prompts missing is a severe minus in terms of reproducibility - and hence how serious I take the paper. I would urgently recommend to the authors to add everything needed to reproduce the results, ideally as a well-coded GitHub repo.
- kvee 2y agohttps://github.com/robertvacareanu/llm4regression https://github.com/robertvacareanu/llm4regression
- rvacareanu 2y agoThe GitHub repo now contains (1) Links to Google Colab for examples + small-scale evaluation; (2) Jupyter Notebooks for small example + small-scale evaluation; Colab links: - GPT-4 Example: https://colab.research.google.com/drive/1Bk9uBCBvzuX00Rex-t1FN6CyB38zgFEt?usp=sharing https://colab.research.google.com/drive/1Bk9uBCBvzuX00Rex-t1... - GPT-4 Small Eval: https://colab.research.google.com/drive/1_-uHvW2oLtcCXz0c-G_yCFnCF10GBBIi?usp=sharing https://colab.research.google.com/drive/1_-uHvW2oLtcCXz0c-G_... - Claude 3 Opus Example: https://colab.research.google.com/drive/105jUAGanp7ZLG-Q9HeijQuhLPWRT1ANM?usp=sharing https://colab.research.google.com/drive/105jUAGanp7ZLG-Q9Hei... - Claude 3 Opus Small Eval: https://colab.research.google.com/drive/1-IH68TUuqf_CZyptSSrzta2MG9RZl9fS?usp=sharing https://colab.research.google.com/drive/1-IH68TUuqf_CZyptSSr...
- data_maan 2y agoMuch appreciated.