3 ms·
Consider the latest 9.1 Ghz push to extremes of CPUs. Consider that there are many stages with up to 30 gates in a sequence that have to be traversed between c
by mikewarot 3y ago
Consider the latest 9.1 Ghz push to extremes of CPUs. Consider that there are many stages with up to 30 gates in a sequence that have to be traversed between clock cycles. If you were to eliminate the long lines, and cut down the number of gates to 10... you could possibly go 20 Ghz, while saving power.
A grid of LUTs, 4 bits in, 4 bits out, clocked in 2 phases, could potentially give you Petaflops of performance with the same transistor count. Your entire program would execute in parallel.
What would you do with an instance of GPT-4 that could output 10 billion tokens per second?