3 ms·

how? There are no cot trajectories afaik. Each token is generated independently. "Analyzing the cot" is a natural language problem. One which we still don't kno

• dilyevsky 17d ago
  there is a number of different methods. One is a separate model/classifier trained with human annotation. Here's a paper by OAI: https://arxiv.org/abs/2305.20050 https://arxiv.org/abs/2305.20050
  • vrighter 16d ago
    A separate model/classifier is just using the same broken tool to fix the broken tool. A model is not an appropriate solution.
    • dilyevsky 15d ago
      > A model is not an appropriate solution that's a bold statement without any supporting argument. more like an opinion really. specially trained classifiers can be very good. sentiment analysis has been a thing for a while now, there had been entire businesses built on this tech where being even slightly wrong can be very costly
      • vrighter 15d ago
        You have a car whose engine occasionally dies when left to idle. The fix for that is not to have a second car with the exact same problem give it a bit of a tow every once in a while. "very good" is the exact same level advertised as the base models they're "protecting". It's not good enough, otherwise we wouldn't be having this conversation in the first place.