3 ms·
TL;DR: code-golf style C program to do inference on an existing TensorFlow model data for GPT2, not full ChatGPT, nor training or anything.
by tgma 2y ago
TL;DR: code-golf style C program to do inference on an existing TensorFlow model data for GPT2, not full ChatGPT, nor training or anything.
- jnwatson 2y agoThis isn't code golf. This is just white space removed.
- slt2021 2y agomore like IOCCC+codegolf style implementation of GPT2 http://www.ioccc.org http://www.ioccc.org
- hnfong 2y agoThere is actually an IOCCC entry in 2019 that does almost exactly this except it’s LSTM instead of transformers: https://www.ioccc.org/2019/mills/prog.c https://www.ioccc.org/2019/mills/prog.c https://www.ioccc.org/2019/mills/hint.html https://www.ioccc.org/2019/mills/hint.html
- benob 2y agoThis one is actually impressive: implements Adam training of RNNs, LSTMs, GRUs.