4 ms·
I'm pretty sure that this is some kind of scientific achievement that I do not fully understand but the real world use cases for this model seem to be very limi
by Lapel2742 11mo ago
I'm pretty sure that this is some kind of scientific achievement that I do not fully understand but the real world use cases for this model seem to be very limited.
I gave it two tasks. "Create a new and original story in 500 words" and "Write a Python console game". Both of those resulted in an endless loop with the model repeating itself
I'm honest. Given that a 1B Granite nano model has only little problems (word count) with such tasks and given that VibeThinker is announced as a programming model it's disappointing to see a 1.6B model fail multiple times.
- impossiblefork 11mo agoIt's specifically trained on maths. I don't think they care at all about general instruction following or stories.
- Lapel2742 11mo ago>> [...] achieving state-of-the-art performance in mathematical and *coding tasks* [...] And it fails at one of the simplest coding tasks where a Granite model at nearly half the size has no problems. It's probably an important discovery but seemingly only usable in an academic context.
- impossiblefork 11mo agoThe way I read the paper is that they've only tuned it on that maths dataset, so it's not made to have any coding ability.
- zhouyi2future 11mo ago[dead]