Beats me. I looked on wikipedia to see if GPTs framework is described without luck. It did say the parameters file (comparable to a csv, very lightweight) is ne

Beats me. I looked on wikipedia to see if GPTs framework is described without luck. It did say the parameters file (comparable to a csv, very lightweight) is nearly a terabyte, which is absolutely insane. Although I want to guess that it is more than an rnn because of how good GPT is, it could be successful solely to its sheer size