I wish someone would update and use PG19 for 7-30B+ model: https://github.com/google-deepmind/pg19 https://github.com/google-deepmind/pg19 That gives us a mod

I wish someone would update and use PG19 for 7-30B+ model: https://github.com/google-deepmind/pg19 https://github.com/google-deepmind/pg19 That gives us a model that's 100% open and reproducible with low, legal risk. It would also be a nice test of how much AI's generalize from or repeat behavior in their pretraining data. Then, a new model using that, The Stack, and FreeLaw's stuff (by paying them to open source it). No Github Issues or anything with questionable licenses or terms of service violations. That could be the next baseline for lawful models with coding ability, too. Research in coding AI's might use it.