3 ms·
Clearly it was meant that they will go away only if you use a custom harness, without the defects that now exist in all vendor-controlled harnesses, because of
by adrian_b 3mo ago
Clearly it was meant that they will go away only if you use a custom harness, without the defects that now exist in all vendor-controlled harnesses, because of the non-aligned goals of the vendor and of the user.
While it was not spelled explicitly, it should be obvious that nothing can be improved if you run locally an LLM in the same way as the vendor. But you should not do that. It is easy to use better methods for sampling procedures and for prompt and context handling.