5 ms·
There is a theory that Deepseek gives based on it's distillation process that hints towards, that o1 is really a distillation of a bigger GPT (GPT5?). Some con
by r00fus 2y ago
There is a theory that Deepseek gives based on it's distillation process that hints towards, that o1 is really a distillation of a bigger GPT (GPT5?).
Some consider this to be spurious/conspiracy.
- impossiblefork 2y agoThere is a big model from NVIDIA that I assume is for this purpose, i.e. Megatron 530b, so it doesn't sound too unreasonable. Edit: I assumed that the model was distillation, that is apparently not true.