3 ms·
Some of these points are very controversial. Having done quite a bit with RAG pipelines, avoiding strongly typing your code is asking for a terrible time. Same
by serjester 3y ago
Some of these points are very controversial. Having done quite a bit with RAG pipelines, avoiding strongly typing your code is asking for a terrible time. Same with avoiding instructor. LLM's are already stochastic, why make your application even more opaque - it's such a minimal time investment.
- maciejgryka 3y agoI think instructor is great! And most of our Python code is typed too :) My point is just that you should care a lot about preserving optionality at the start because you're likely to have to significantly change things as you learn. In my experience going a bit cowboy at the start is worth it so you're less hesitant to rework everything when needed - as long as you have the discipline to clean things up later, when things settle.
- minimaxir 3y ago> LLM's are already stochastic That doesn't mean it's easy to get what you want out of them. Black boxes are black boxes.