3 ms·
I start to believe that adding more and more and more and more and more thinking tokens is the hack that works (this is what gave birth to Fable)
by rvnx 4mo ago
I start to believe that adding more and more and more and more and more thinking tokens is the hack that works (this is what gave birth to Fable)
- utopiah 4mo agoWhy would you not think that? It seems pretty intuitive that pouring more resources into a problem (more GPU, bigger GPUs with more VRAM, bigger datasets, better curated datasets, more efficient ways to train, more efficient way to run inference, etc) then running the result for a longer time, with more layers of verification (running in VMs, model fusion comparing multiple models, having harnesses with testing) will at least lead to marginally better results. Is it worth it and at what pace will it keep on improving are different questions but I have little doubt that if the industry keep on pouring resources, sure more "works".