3 ms·
Makes sense. It isn't in the list of suggested usecases, but I wonder if this can be used to speed up tree of thoughts or similar prompt/search techniques. It
by sebzim4500 2y ago
Makes sense.
It isn't in the list of suggested usecases, but I wonder if this can be used to speed up tree of thoughts or similar prompt/search techniques.
It could also speed up restricted generation, e.g. when you force the model to output valid json.