4 ms·
> on ~1 million C programs, compared to [...] 2 trillion tokens, which is a few orders of magnitude more data. Is that comparable like that? This would assume
by mattashii 3y ago
> on ~1 million C programs, compared to [...] 2 trillion tokens, which is a few orders of magnitude more data.
Is that comparable like that? This would assume that the average C program of the set is orders (plural) of magnitude less than 2m tokens in size, which could indeed be true but sounds like an optimistic assumption.