There are current open source projects working on training their own LLMs. I'm aware of one very credible one that has applied for a TPU grant from Google wort

There are current open source projects working on training their own LLMs. I'm aware of one very credible one that has applied for a TPU grant from Google worth under $200K to train the whole model. I think laion.ai will probably get their first with their fleet of A100s though.