4 ms·

Sounds like just the sort of thing FGPA's were made for. The $$$ would probably make my eyes bleed tho.

• chrsw 7mo ago
  Current FPGAs would have terrible performance. We need some new architecture combining ASIC LLM perf and sparse reconfiguration support maybe.
• 0x457 7mo ago
  Wouldn't it be the opposite of freezing weights?