This is interesting but i think generating the next letter from the letters before may not be the best way to do it. As you mentioned they degrade with each let

This is interesting but i think generating the next letter from the letters before may not be the best way to do it. As you mentioned they degrade with each letter. Maybe creating one long image of a whole font would work better. edit: in the above am misunderstanding what is happening here. But i still think there must be another way to structure this so the attention mechanism doesn't have to work so hard.