4 ms·
It is possible that it will hit a dead end. But I believe nobody expected the current architecture to be anywhere near this good. I can literally tell it, in p
by tgsovlerkhgsel 4y ago
It is possible that it will hit a dead end. But I believe nobody expected the current architecture to be anywhere near this good.
I can literally tell it, in plain text with a single example, to become a home assistant to control the lights and output JSON, then prompt it with natural language like "make it look like a submarine on battle stations" and it will output a setting where all the lights are red. In the exact format I asked it to use.
That's a bit more than "appearing to solve a problem". That, right there, is a directly usable application. I could literally plug a speech to text -> ChatGPT -> something that filters invalid JSON -> light controls together, teach it a few more commands, and have a much better home assistant than anything I've seen commercially available, limited mainly by the speech recognizer.
The incredible thing about this is that it can't just do that with ONE problem, it can do that with MOST simple problems that don't require really extensive background knowledge, and it is clearly able to encode knowledge (battlestations -> red), so it seems plausible to me that more data will let it handle more knowledge.
- haldujai 4y agoI'm not sure thats as impressive as it seems. It's good at predicting sequeneces that it has seen before, so STS on steroids. It's good filtering invalid JSON because it's seen how to do that many times, and is basically acting as a very good semantic text similarity with generative output. If you ask it to act in a way of something that is niche enough to not be something it's seen a lot it fails horribly. We haven't exactly figured out what exactly it's encoding. I do not think this empiric example is proof of that, whether the model actually has understanding of what 'red' is as a human does is yet to be determined.
- kanbara 4y agoi asked chatgpt to generate hex colours in a pleasing palette. the hex codes matched the colours, and the palette was alright but one colour was off. then i told it to replace the colour but keep the others the same, and it picked new slightly different hex colours.
- haldujai 4y agoAnd this demonstrates what exactly?