3 ms·
I have seen it do exactly that, in a "hands thrown up" fashion. Note the levels of "thinking" that occur on NOT assertions. Those streams typically keep things
by z3c0 1mo ago
I have seen it do exactly that, in a "hands thrown up" fashion.
Note the levels of "thinking" that occur on NOT assertions. Those streams typically keep things on track. It's not that saying "don't use the Internet" will cause it to rebuke cos misalignment (a childish concept made by laymen, I'll add.) It's that the odds of it later "forgetfully" spewing in a thought stream, "wait, I have't checked the Internet" goes up substantially.
Saying "using only offline methods, do xyz" limits those odds considerably.
This isn't opinion or anecdote -- just how the model works. The additional guardrails to keep the model on track are bolted on via finetuning, hence the increasing jankiness.