4 ms·
This can work great until the models get tweaked and you realize you’ve been working based on the currents of the model this week. Creating a robust enough set
by j45 2mo ago
This can work great until the models get tweaked and you realize you’ve been working based on the currents of the model this week.
Creating a robust enough setup that can work on different models or different versions of a model is critical.
- tosh 2mo agoI agree in principle but in practice this is not easy even with a robust, well thought through setup every model behaves in its own way, some adhere more to a system prompt, another model has more recent cut-off time and knows about new parts in the stdlib some oversteer, some understeer … if you want the best performance unfortunately there is not really a way other than to constantly adapt the harness/clutches/context to the model du jour
- j45 2mo agoI agree in any practice, it's not easy :) In a non-deterministic world the compiler is no longer consistent anyways.