3 ms·
The validation procedure is described on page 8 of the TOPLOC paper: https://arxiv.org/abs/2501.16007 https://arxiv.org/abs/2501.16007 The checksum is validate
by yorwba 1y ago
The validation procedure is described on page 8 of the TOPLOC paper: https://arxiv.org/abs/2501.16007 https://arxiv.org/abs/2501.16007
The checksum is validated by redoing the computation, but making use of the fact that you already have the entire response to enable greater parallelism than when generating it one token at a time.