5 ms·
I'm surprised that Nemotron gets mentioned at all. In my experiments with it for coding tasks it performed extremely poorly, essentially unusable.
by vcryan 4mo ago
I'm surprised that Nemotron gets mentioned at all. In my experiments with it for coding tasks it performed extremely poorly, essentially unusable.
- nostrebored 4mo agoit is pretty good at instruction following and has extremely fast decode.
- jameshush 4mo agoI focus on realtime voice AI uses cases and nemotron's time to first token is INSANELY fast. It's become a legit option for voice use cases