Streams weights instead of data sounds really interesting - I had never considered it. Something else that might be theoretically possible is - Large array of

Streams weights instead of data sounds really interesting - I had never considered it. Something else that might be theoretically possible is - Large array of FPGAs are apparently used to simulate and verify chips [1], can the same be done to run LLMs? Can we have 0.25 to 1 token per cycle, would the engineering effort be worth it, and would it be financially feasible from a TCO standpoint? [1] https://www.servethehome.com/amd-vp1902-is-leviathan-fpga-doubling-the-previous-gen-largest-fpga/ https://www.servethehome.com/amd-vp1902-is-leviathan-fpga-do...