Have you seen the recent work at TinyStories: - https://arxiv.org/abs/2305.07759 https://arxiv.org/abs/2305.07759 It got some nice attention here: - https:

Have you seen the recent work at TinyStories: - https://arxiv.org/abs/2305.07759 https://arxiv.org/abs/2305.07759 It got some nice attention here: - https://github.com/karpathy/llama2.c https://github.com/karpathy/llama2.c I think there may be some applications in this limited space that are worth looking into. You won’t replicate GPT-anything but it may be possible to solve some nice problems very much more efficiently that one would expect at first.