3 ms·

I don't see that stall. All of the tools I use get increasingly better every quarter at the very least (coding tools, research, image generation, etc).

afavour 1y ago
As always it’s hype vs reality. Today we’re told AGI is just around the corner. It isn’t. You’re right that a lot of tools are improving iteratively and that’s great but the hyped up valuations we’re seeing are valuing coding assistants, they’re valuing a fictional reality where AGI solves everything and the first one there gets all the rewards.
- epolanski 1y ago
  I haven't said a word about hype nor AGI, I merely said that LLM evolution in the tools available right now, not in the future has neither plateaued nor stalled. I'm not expressing any judgement on the economics of it.
Bender 1y ago
It probably depends on the topics people are interacting with. I've spent the last few days teaching Grok how to manage iptables and nftables when all I wanted was to translate my u32 module rules into nftables and I was being lazy, something the provided translate scripts can not do. Grok would confidently give me an answer, I would say that is wrong and it would admit straight away it was wrong and would confidently give me another wrong answer and I would teach it the right answer after a bit of bumbling on my part. It feels worse than being an editor on serverfault but that's just the silly topics I play with. It could be that most topics it does fine but that has not been my experience thus far. At the end of the day I would have been better off just sticking with the man pages and tcpdump.
- Bender 1y ago
  Adding today I tested some u32 nftable equiv rules and ran into similar issues on chatgpt. Provided I set chatgpt what OS+version and nftables version I am using it will get some of the IP header locations correct but it still gets the syntax wrong for the older version of nftables that Alpine ships with. Sometimes it does get the older syntax right, sometimes not. If I correct it chatgpt it will agree that is a safer method so I should probably start by saying to use the older methods. Both Grok and ChatGPT appear to have learned from the same sub-optimal locations.

afavour 1y ago

As always it’s hype vs reality. Today we’re told AGI is just around the corner. It isn’t. You’re right that a lot of tools are improving iteratively and that’s great but the hyped up valuations we’re seeing are valuing coding assistants, they’re valuing a fictional reality where AGI solves everything and the first one there gets all the rewards.

epolanski 1y ago
I haven't said a word about hype nor AGI, I merely said that LLM evolution in the tools available right now, not in the future has neither plateaued nor stalled. I'm not expressing any judgement on the economics of it.

Bender 1y ago

It probably depends on the topics people are interacting with. I've spent the last few days teaching Grok how to manage iptables and nftables when all I wanted was to translate my u32 module rules into nftables and I was being lazy, something the provided translate scripts can not do. Grok would confidently give me an answer, I would say that is wrong and it would admit straight away it was wrong and would confidently give me another wrong answer and I would teach it the right answer after a bit of bumbling on my part. It feels worse than being an editor on serverfault but that's just the silly topics I play with. It could be that most topics it does fine but that has not been my experience thus far. At the end of the day I would have been better off just sticking with the man pages and tcpdump.

Bender 1y ago
Adding today I tested some u32 nftable equiv rules and ran into similar issues on chatgpt. Provided I set chatgpt what OS+version and nftables version I am using it will get some of the IP header locations correct but it still gets the syntax wrong for the older version of nftables that Alpine ships with. Sometimes it does get the older syntax right, sometimes not. If I correct it chatgpt it will agree that is a safer method so I should probably start by saying to use the older methods. Both Grok and ChatGPT appear to have learned from the same sub-optimal locations.