2 ms·
In these types of tutorial, can't we move tokenization to the end and just start with a model that inputs and outputs bytes (latin-1) instead? That would (1) t
by amelius 7mo ago
In these types of tutorial, can't we move tokenization to the end and just start with a model that inputs and outputs bytes (latin-1) instead?
That would (1) take the reader to the real meat sooner, and would (2) make it way more compelling why we need something as convoluted as tokenization.