3 ms·

You said you don't have access but based on your tests... Were you testing ChatGPT I just tried and it was able to play tic tac toe, reverse a string (the stri

by bko 4y ago

You said you don't have access but based on your tests... Were you testing ChatGPT I just tried and it was able to play tic tac toe, reverse a string (the string was "hello world.i am new to this so please forgive me if i can't reverse a sentence") Hangman sort of worked but it said every letter I picked was correct and appears to have constructed a word based on my guesses. Very strange behavior

chmod775 4y ago
Try making it reverse this: "Quickly, the kangaroo hopped away, escaping under the azure sky." I couldn't make it reverse that correctly even after prompting it five times to fix its mistakes. Most commonly it writes: ".yks eruz a eht rednu gnipacse ,yawa depoh ooragnak eht ,ylkciuQ" It also can't find the mistakes in there for the life of it.
- shagie 4y ago
  Remember that GPT is working on input tokens and output tokens. Its output is tokens that then get converted back into text. Taking [21063, 306, 11, 262, 479, 648, 38049, 45230, 1497, 11, 25071, 739, 262, 35560, 495, 6766, 13] to expect it to output back [13, 88, 591, 13724, 4496, 304, 4352, 2266, 28803, 19967, 541, 330, 325, 837, 88, 6909, 390, 381, 1219, 267, 273, 4660, 461, 304, 4352, 837, 2645, 74, 979, 84, 48] is a difficult problem that it is not well suited for.
- chankstein38 4y ago
  That's because it's trained on the relations of words to each other and not on string manipulation. This is not its purpose. It may be capable of it to some degree but that seems like more of a luck of the draw kind of thing than something we should expect it to be good at.
- cdelsolar 4y ago
  It is insane that it can get that close, and it’s actually more impressive that it makes small typos than if it didn’t.
  - chankstein38 4y ago
    right? It makes it feel like it's actually trying to do it versus just having some backdoor'd string reverse function
- deleted 4y ago
  [deleted]

by bko 4y ago

chmod775 4y ago

Try making it reverse this: "Quickly, the kangaroo hopped away, escaping under the azure sky." I couldn't make it reverse that correctly even after prompting it five times to fix its mistakes. Most commonly it writes: ".yks eruz a eht rednu gnipacse ,yawa depoh ooragnak eht ,ylkciuQ" It also can't find the mistakes in there for the life of it.

shagie 4y ago
Remember that GPT is working on input tokens and output tokens. Its output is tokens that then get converted back into text. Taking [21063, 306, 11, 262, 479, 648, 38049, 45230, 1497, 11, 25071, 739, 262, 35560, 495, 6766, 13] to expect it to output back [13, 88, 591, 13724, 4496, 304, 4352, 2266, 28803, 19967, 541, 330, 325, 837, 88, 6909, 390, 381, 1219, 267, 273, 4660, 461, 304, 4352, 837, 2645, 74, 979, 84, 48] is a difficult problem that it is not well suited for.
chankstein38 4y ago
That's because it's trained on the relations of words to each other and not on string manipulation. This is not its purpose. It may be capable of it to some degree but that seems like more of a luck of the draw kind of thing than something we should expect it to be good at.
cdelsolar 4y ago
It is insane that it can get that close, and it’s actually more impressive that it makes small typos than if it didn’t.
- chankstein38 4y ago
  right? It makes it feel like it's actually trying to do it versus just having some backdoor'd string reverse function
deleted 4y ago
[deleted]