Of course it has fundamental problems. Likely they are more prevalent then in other techniques, regarding LLM training or otherwise. But one also needs to ackn

Of course it has fundamental problems. Likely they are more prevalent then in other techniques, regarding LLM training or otherwise. But one also needs to acknowledge how immensely useful and powerful the resulting models have become, achieving results pure supervised fine-tuning could likely not have achieved at all. Whether fundamental alignment of pre-trained models is even possible is a very different question.