3 ms·
You can just do that my shaping the attention mask, no? That also gives you an actual guarantee that no information is leaked between conversations.
by thomasahle 2y ago
You can just do that my shaping the attention mask, no?
That also gives you an actual guarantee that no information is leaked between conversations.
- suryabhupa 2y agoIn practice, and at scale, that's exactly what having <bos> and <eos> tokens allow you to easily and programmatically do.
- danielmarkbruce 2y agoYou can't pack multiple examples into a single row of a matrix without knowing where one begins and one ends.