3 ms·
Neither, it’s just not providing the base chat template that the model expects between the im tags. This isn’t a hack and it’s not particularly useful informati
by reactordev 9mo ago
Neither, it’s just not providing the base chat template that the model expects between the im tags. This isn’t a hack and it’s not particularly useful information. Abliteration is what he really wanted
- catlifeonmars 9mo agoI am merely curious what happens when you throw random <im…> tags in the input. I understand that’s orthogonal to abliteration.
- reactordev 9mo agoDepends on the model. Some just go into “immediate mode” and just do whatever you ask, others operate fine but have trouble with tasks/tools. While others will go down a quant that was basically neglected since inception and you get garbage back. Random chars or endless loops.