4 ms·

It is previous architecture and it doesnt support newer version of Flash Attention , fp8 training etc

• halyconWays 2y ago
  That's fair. I did run into that issue when trying to speed up Hunyuan
• jszymborski 2y ago
  It is, however, like 3x cheaper.