2 ms·
o3 is still a transformer-based LLM, just one with a different loss function
by apsec112 2y ago
o3 is still a transformer-based LLM, just one with a different loss function
- simonw 2y agoHuh, yeah that's a good point. The various distilled R1 models are definitely regular transformer-based LLMs because the GGUF file versions of them work without any upgrades to the underlying llama.cpp library.