>we can solve the problem of machine learning being based on bad bots by throwing more bots at it Yes, you can solve dataset problems with models. Look at Cons

>we can solve the problem of machine learning being based on bad bots by throwing more bots at it Yes, you can solve dataset problems with models. Look at ConstitutionalAI from Anthropic. They only write a set of rules (the so called constitution) and the AI will derive a large dataset of demonstrations all by itself. This can do away with the RLHF stage where OpenAI has the best results so far, but costs money to label and is harder to update. The model "Claude" from Anthropic is being discussed recently on Twitter https://pbs.twimg.com/media/Flyt8qiWIAEPwZl?format=jpg https://pbs.twimg.com/media/Flyt8qiWIAEPwZl?format=jpg