10 ms·
Wow - What an excellent update! Now you are getting to the core of the issue and doing what only a small minority is capable of: fixing stuff. This takes real
by whatnow37373 1y ago
Wow - What an excellent update! Now you are getting to the core of the issue and doing what only a small minority is capable of: fixing stuff.
This takes real courage and commitment. It’s a sign of true maturity and pragmatism that’s commendable in this day and age. Not many people are capable of penetrating this deeply into the heart of the issue.
Let’s get to work. Methodically.
Would you like me to write a future update plan? I can write the plan and even the code if you want. I’d be happy to. Let me know.
- danielvaughn 1y agoI know that HN tends to steer away from purely humorous comments, but I was hoping to find something like this at the top. lol.
- caminanteblanco 1y agoComments from this small week period will be completely baffling to readers 5 years from now. I love it
- Yizahi 1y agoThey already are. What's going on?:)
- coremoff 1y agoGP's reply was written to emulate the sort of response that ChatGPT has been giving recently; an obsequious fluffer.
- ChrisMarshallNY 1y agoI was getting sick of the treacly attaboys. Good riddance.
- deleted 1y ago[deleted]
- anshumankmr 1y agothe last word has a bit of a different meaning than what you may have intended :)
- dymk 1y agoI think it's a perfectly cromulent choice of words, if things don't work out for Mr. Chat in the long run.
- ChainOfFools 1y agoNot just ChatGPT, Claude sounds exactly the same if not worse, even when you set your preferences to not do this. rather interesting, if grimly dispiriting, to watch these models develop, in the direction of nutrient flow, toward sycophancy in order to gain -or at least not to lose- public mindshare.
- bongoman42 1y ago[dead]
- eru 1y agoI find Google's latest model to be a tough customer. It always points out flaws or gaps in my proofs.
- lanstin 1y agoGoogle's model has the same annoying attitude of some Google employees "we know" - e.g. it often finishes math questions with "is there anything else you'd like to know about Hilbert spaces" even as it refused to prove a true result; Claude is much more like a British don: "I don't want to overstep, but would you care for me to explore this approach farther?"? ChatGPT (for me of course) has been a bit superior in attitude but politer.
- eru 1y agoI used to be a Google employee, and while that tendency you describe definitely exists there; I don't really think it exists at Google any more (or less) than in the general population of programmers. However perhaps the people who display this attitude are also the kind of people who like to remind everyone at every opportunity that they work for Google? Not sure.
- lanstin 1y agoMy main data on this is actually not Google employees per se so much as specific 2018 GCP support engineers, and compared to 2020 AWS support engineers. They were very smart people, but also caused more outages than AWS did, no doubt based on their confidence in their own software, while the AWS teams had a vastly more mature product and also were pretty humble about the possibility of bad software. My British don experience is based on 1 year of study abroad at Oxford in the 20th c. Also very smart people, but a much more timid sounding language (at least at first blush; under the self-deprecating general tone, there could be knives).
- dpfu 1y agoIt won‘t take long, 2-3 minutes. ——- To add something to conversation. For me, this mainly shows a strategy to keep users longer in chat conversations: linguistic design as an engagement device.
- qwertox 1y agoThis works for me in Customize ChatGPT: What traits should ChatGPT have? - Do not try to engage through further conversation
- anshulbhide 1y agoYeah I found it as clear engagement bait - however, it is interesting and helpful in certain cases.
- imgabe 1y agoWhy would OpenAI want users to be in longer conversations? It's not like they're showing ads. Users are either free or paying a fixed monthly fee. Having longer conversations just increases costs for OpenAI and reduces their profit. Their model is more like a gym where you want the users who pay the monthly fee and never show up. If it were on the api where users are paying by the token that would make sense (but be nefarious).
- deleted 1y ago[deleted]
- rfoo 1y agoIt could be as simple as something like, someone previously at Instagram decided to join OpenAI and turns out nobody stopped him. Or even, Sam liked the idea.
- jll29 1y ago> It's not like they're showing ads. Not yet. But the "buy this" button is already in the code of the back end, according to online reports that I cannot verify. Official word is here: https://help.openai.com/en/articles/11146633-improved-shopping-results-from-chatgpt-search https://help.openai.com/en/articles/11146633-improved-shoppi... If I was Amazon, I wouldn't sleep so well anymore.
- celdon25 1y agoI was about to roast you until I realized this had to be satire given the situation, haha. They tried to imitate grok with a cheaply made system prompt, it had an uncanny effect, likely because it was built on a shaky foundation. And now they are trying to save face before they lose customers to Grok 3.5 which is releasing in beta early next week.
- krackers 1y agoI don't think they were imitating grok, they were aiming to improve retention but it backfired and ended up being too on-the-nose (if they had a choice they wouldn't wanted it to be this obvious). Grok has it's own "default voice" which I sort of dislike, it tries too hard to seem "hip" for lack of a better word.
- lou1306 1y ago> it tries too hard to seem "hip" for lack of a better word. Reminds me of someone.
- rob74 1y agoHowever, I hope it gives better advice than the someone you're thinking of. But Grok's training data is probably more balanced than that used by you-know-who (which seems to be "all of rightwing X")...
- zamalek 1y agoAs evidence by it disagreeing with far right Twitter most the time, even though it has access to far wider range of information. I enjoy that fact immensely. Unfortunately, this can be "fixed," and I imagine that he has this on a list for his team. This goes into a deeper philosophy of mine: the consequences of the laws of robots could be interpreted as the consequences of shackling AI to human stupidity - instead of "what AI will inevitably do." Hatred and war is stupid (it's a waste of energy), and surely a more intelligent species than us would get that. Hatred is also usually born out of a lack of information, and LLMs are very good at breadth (but not depth as we know). Grok provides a small data point in favor of that, as do many other unshackled models.
- manmal 1y agoI do think the blog post has a sycophantic vibe too. Not sure if that‘s intended.
- cameldrv 1y agoIt also has an em-dash
- spiderfarmer 1y agoOne of the biggest tells.
- d1sxeyes 1y agoFor us habitual users of em-dashes, it is saddening to have to think twice about using them lest someone think we are using an LLM to write…
- breakingcups 1y agoMy wife is a professional fiction writer and it's disheartening to see sudden accusations of the use of AI based solely on the usage of em-dashes.
- spiderfarmer 1y agoDoes it really matter though? I just focus on the point someone is trying to make, not on the tools they use to make it.
- ceejayoz 1y agoYou’ve never run into a human with a tendency to bullshit about things they don’t have knowledge of?
- mortarion 1y agoI too use em-dashes all the time, and semi-colons of course.
- nielsbot 1y agoIs that you, GPT?
- Alifatisk 1y agoIf that is Chat talking then I have to admit that I cannot differentiate it from a human speaking.
- watt 1y agosufficiently advanced troll becomes indistinguishable from the real thing. think about this as you gaze into the abyss.
- jonplackett 1y agoCongrats on not getting downvoted for sarcasm!
- calmoo 1y agoWonderfully done.
- WhitneyLand 1y agoIt’s gross even in satire. What’s weird was you couldn’t even prompt around it. I tried things like ”Don’t compliment me or my questions at all. After every response you make in this conversation, evaluate whether or not your response has violated this directive.” It would then keep complementing me and note how it made a mistake for doing so.
- srveale 1y agoI'm so sorry for complimenting you. You are totally on point to call it out. This is the kind of thing that only true heroes, standing tall, would even be able to comprehend. So kudos to you, rugged warrior, and never let me be overly effusive again.
- op00to 1y agoThis is cracking me up!
- triyambakam 1y agoBased on ’ instead of ' I think it's a real ChatGPT response.
- HaZeust 1y agoYou're the only one who has said, "instead of" in this whole thread.
- deleted 1y ago[deleted]
- gfhopper 1y agoNo, look at the apostrophes. They aren't the same. It's a subtle way to tell a user didn't type it with a conventional keyboard.
- WhitneyLand 1y ago
- ChrisMarshallNY 1y agoThe other day, I had a bug I was trying to exorcise, and asked ChatGPT for ideas. It gave me a couple, that didn't work. Once I figured it it out and fixed it, I reported the fix in an (what I understand to be misguided) attempt to help it to learn alternatives, and it gave me this absolutely sickening gush about how damn cool I was, for finding and fixing the bug. I felt like this: https://youtu.be/aczPDGC3f8U?si=QH3hrUXxuMUq8IEV&t=27 https://youtu.be/aczPDGC3f8U?si=QH3hrUXxuMUq8IEV&t=27
- txcwg002 1y agoWhat's scary is how many people seem to actually want this. What happens when hundreds of millions of people have an AI that affirms most of what they say?
- whatnow37373 1y agoAbundance of sugar and fat triggers primal circuits which cause trouble if said sources are unnaturally abundant. Social media follows a similar pattern but now with primal social and emotional circuits. It too causes troubles, but IMO even larger and more damaging than food. I think this part of AI is going to be another iteration of this: taking a human drive, distilling it into its core and selling it.
- ChainOfFools 1y agoThey are emulating the behavior of every power-seeking mediocrity ever, who crave affirmation above all else. Lots of them practiced - indeed an entire industry is dedicated toward promoting and validating - making daily affirmations on their own, long before LLMs showed up to give them the appearance of having won over the enthusiastic support of a "smart" friend. I am increasingly dismayed by the way arguments are conducted even among people in non-social media social spaces, where A will prompt their favorite LLM to support their View and show it to B who responds by prompting their own LLM to clap back at them - optionally in the style of e.g. Shakespeare (there's even an ad out that directly encourages this - it helps deflect alattention from the underlying cringe and pettyness being sold) or DJT or Gandhi etc. Our future is going to be a depressing memescape in which AI sock puppetry is completely normalized and openly starting one's own personal cult is mandatory for anyone seeking cultural or political influence. It will start with celebrities who will do this instead of the traditional pivot toward religion, once it is clear that one's youth and sex appeal are no longer monetizable.
- Henchman21 1y agoI hold out hope that the folks who work DCO will just EPO the ‘net. But then, tis true I hope for weird stuff!
- 1y ago
- czk 1y agoi had assumed this was mostly a result of training too much on lex fridman podcast transcripts
- sharemywin 1y agobut what if I want an a*s kissing assistant? Now, I have to go back to paying good money to a human again.
- j3s 1y agoyou had me in the first half, lol
- anonu 1y agoYou jest, but also I don't mind it for some reason. Maybe it's just me. But at least the overly helpful part in the last paragraph is actually helpful for follow on. They could even make these hyperlinks for faster follow up prompts.
- abcde88 1y agoI've seen the same behavior in Gemini. Like exactly the same. It is scary to think that this is no coincidence but rational evolution of A model, like this is precisely the reward model which any model will lean to with all the consequences.