4 ms·
"Our models are more honest" honey the quarterly marketing spin for a ML term has come. Forget "task alignment" now we're going for "truth index". I suppose thi
by alansaber 5mo ago
"Our models are more honest" honey the quarterly marketing spin for a ML term has come. Forget "task alignment" now we're going for "truth index". I suppose this is the only way to generate hype when you're selling/releasing the same product over and over again.
- TIPSIO 5mo agoWhen doing some electrical, Opus 4.7 essentially told me to wiggle a wire to see if it was hot or not with my bare hand. I called it out. It then gave me one of the most super heartfelt honest and sincere apologies I have ever received. Glad the safety team was there for me and able to make such an honest model or I would have been very upset about it.
- teaearlgraycold 5mo agoOpus is so bad at electrical work it's really disappointing. And when it tries to draw schematics as SVGs it's a complete disaster. They should either focus on training their LLMs on this task specifically, or have it refuse.
- tclancy 5mo agoHmm, what kind of electrical work? I had it "watch over my shoulder" as I swapped out the pressure switch on our home well and it was a big help. And in the run up to that when I explained opening the 220 box and checking that was "above my paygrade" it limited our investigation to just the less sparky parts.
- teaearlgraycold 5mo agoI mean introductory circuit stuff. Not electrician-lite work.
- morpheos137 5mo agohave it write python porogram to generate the svgs. then use the program. circuit diagrams are rrlatively thin corpus but it knows how ciruits work sufficently to write a program.
- deleted 5mo ago[deleted]
- teaearlgraycold 5mo agoIs there a good pre-existing DSL for this task?
- tclancy 5mo agoYou ain’t gotta be sniffy about it, English.
- BoorishBears 5mo agoSVG is like asking an electrician to give you a circuit diagram by painting a watercolor I'd try something like CircuiTikZ with instructions provided
- krupan 5mo agoI honestly cannot tell if you are being sarcastic or not
- TIPSIO 5mo agoIt did try and lead me to touch a live hot wire once. Thanking the safety team for the honest and sincere apology it gave after was sarcasm.
- krupan 5mo agoIt tried to get you touch a live wire, then you called it honest and thanked the safety team. It really comes off as sarcastic.
- BoorishBears 5mo agoSo you can tell.
- mrdependable 5mo agoGave me wrong information on my very first question. Wasn’t even complicated, and I wasn’t trying to trick it.
- doginasuit 5mo agoCredit where it is due, Claude is fantastic at pointing out potential flaws in how I understand the problem based on my question. I asked for this in the system instructions but it is the first model I've tried that does it regularly. It is also so tactful, I feel like I'm learning social skills from a language model. Half of the time it is a false positive due to insufficient context but I still appreciate the additional check.