3 ms·
Any idea how ascii art is even parsed by these models? I know simple language models would basically just disregard it. Does gpt have some built in parsing that
by version_five 5y ago
Any idea how ascii art is even parsed by these models? I know simple language models would basically just disregard it. Does gpt have some built in parsing that treats each symbol in ascii art as a token to try and actually learn a model for it? This would be an interesting thing to try and build. I feel like I remember seeing a vision transformer model that you could give the start of an image to and it would make up the rest, I guess this would be a similar concept. Overall it's not necessarily a logical extension of a language model though
- p1esk 5y agoEach special symbol is a distinct token.