4 ms·
Oh interesting and good to know on the token savings with this technique. My test with claude had it use vision and then programmatically test different variabl
by billtarbell 4mo ago
Oh interesting and good to know on the token savings with this technique. My test with claude had it use vision and then programmatically test different variable font input variables (mimicking the user scrub interaction) until it was able to OCR it.
- anon291 4mo agoI mean I can't know for sure but I'm pretty sure that by the time the upper layers of the network are reached the lower level networks have already transformed the image tiles into proper position encoded embeddings of the tokens in the words in the image. That would be my operating assumption at least.
- billtarbell 4mo agoThe encoded data and the font file go over the network. The font file is executed locally on the readers machine.
- anon291 4mo agoMy point is you can just render the file and send to AI...