4 ms·
oh interesting, this is gonna be pretty helpful if it could actually recognize some pattern of errors even if the stack trace is different. (i.e. some shared fu
by hellovai 3y ago
oh interesting, this is gonna be pretty helpful if it could actually recognize some pattern of errors even if the stack trace is different. (i.e. some shared function call fails, but that function is used within a bunch of different functions). have you had any thoughts on if fine tuned models would work better for your specific use case?
- podoman 3y ago(I'm one of the Highlight.io founders). Yep, that's the intention. And anecdotally, it works pretty well, even without fine-tuning. We started working on this before any of the fine-tuning APIs for OpenAI came out, but we are keeping an eye out for support for fine-tuning on more OSS models. I suspect it would result in better results, especially if it were trained on only exceptions, for example.