Perhaps something like this: https://neurips.cc/virtual/2024/poster/94115 https://neurips.cc/virtual/2024/poster/94115 Though I haven't looked up what their act

Perhaps something like this: https://neurips.cc/virtual/2024/poster/94115 https://neurips.cc/virtual/2024/poster/94115 Though I haven't looked up what their actual tokenization strategy is, and whether switching to hierarchical (H-Net) chunks would be possible.