3 ms·
Mythos is a much bigger pre train, Contemplating is not the same thing.
by solenoid0937 7mo ago
Mythos is a much bigger pre train, Contemplating is not the same thing.
- zozbot234 7mo ago> Mythos is a much bigger pre train Do we have data to substantiate that claim?
- solenoid0937 7mo agoIt's pretty common knowledge. Spud is the only other PT comparable with Mythos. Both Spud and Mythos can also scale via inference time compute. Meta simply did not have enough compute online, long enough ago, to have a similar PT.