Update: added result section to my post with more details: https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guide.html#results https://16x.engineer/2023/

Update: added result section to my post with more details: https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guide.html#results https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guid... I don't think it can go any smaller and demonstrate its capabilities. Even GPT-2 is mostly generating nonsensical sentences that resembles English. You might be looking at ngram or markov model for simpler NLP capabilities.