3 ms·
Two more practices that are relevant to how transformers work: - instead of using it as a source of facts, use it to transform the text with the facts you prov
by orbital-decay 3y ago
Two more practices that are relevant to how transformers work:
- instead of using it as a source of facts, use it to transform the text with the facts you provide, which is does much better. (if the accuracy is important for your case)
- to improve the answer, ask it to reflect on its own result and reiterate the answer. The model produces the result token by token, so it's unable to check its validity at the inference time. This way you put it back into the context and explicitly tell the model to make a second pass.