I don't know if these open source models will be better. The one's I've seen so far have been pretty terrible. OpenAI did a million little hacks to get the LLM

I don't know if these open source models will be better. The one's I've seen so far have been pretty terrible. OpenAI did a million little hacks to get the LLM to produce such good responses. Even google couldn't figure out a better way to train their model than to fit it to GPT responses. This may be a heretical opinion here, but open source doesn't always win esp if its an incredibly technical task and it costs a lot to train and host. Why didn't open source get us a reasonable search engine? Why isn't LibreOffice as good as Microsoft Office? Why do we pay for any software? I mean sure, you can always cheat. You can pay someone to write essays for you or take your tests. But watermarks would be a huge step forward to detect AI generated content.