3 ms·
I think models using these harnesses were also RLHF'd hard on responding to looping instructions and following through on goals. Older models were tuned for bas
by abixb 29d ago
I think models using these harnesses were also RLHF'd hard on responding to looping instructions and following through on goals. Older models were tuned for basic chat responses.
- NiloCK 29d agoIf someone could tune models of that size to have comparable effectiveness at much much lower costs, they would have done so by now. "The harness improvements are the real sauce" is like a sincere "It's gotta be the shoes" take about Micheal Jordan. (For the younger: that line was from a series of Nike ads where his skills were being explained)
- mullingitover 28d agoIt's more like we just invented ball bearings. We just jumped from standard to industrial grade, and precision grade is on the horizon. All kinds of new possibilities have opened up, cars can go a mile a minute on these things! Surely if we keep increasing the precision at this rate, we'll defeat friction once and for all.