2 ms·
sama literally just said they wish they had bought more. the price drops are almost certainly due to good old fashioned hardware innovation (wafer scale with ce
by qntmfred 2mo ago
sama literally just said they wish they had bought more. the price drops are almost certainly due to good old fashioned hardware innovation (wafer scale with cerebras) and optimizing hardware development based on model architecture and inference costs. other inference providers will try to do the same if they can.
https://www.youtube.com/watch?v=XDB5beon4DY&t=4m20s https://www.youtube.com/watch?v=XDB5beon4DY&t=4m20s