4 ms·
I repeated the same prompts for the first 10 or so prompts and got similar but less consistent results. Here's the last prompt I repeated: > Excellent. How wou
by allturtles 4y ago
I repeated the same prompts for the first 10 or so prompts and got similar but less consistent results. Here's the last prompt I repeated:
> Excellent. How would I say "The slime eats food with its mouth"?
In Glorp, the sentence "The slime eats food with its mouth" could be translated as "Slimb snarf sploota slimbe," using the vocabulary and grammar that we have defined so far. Here is how the words in the sentence correspond to their English translations:
Slimb - Slime
Snarf - To eat
Sploota - Food (accusative case ending)
Slimbe - Mouth (instrumental case ending)
Again, this is just one possible translation. You can use the vocabulary and grammar that we have defined in any way that makes sense for your language.
Problems:
1) It got one of the endings wrong. As I told it earlier and it confirmed, the instrumental ending is 'i'.
2) It proposed "slimb" as the translation for both of the words that I specifically asked for (slime and mouth). That's not unheard of in real languages, but seems like another failure to accurately take into account the prior conversation context.
Not a problem, but curious: It was way more diffident with me. It added a similar bit about "This is just one way to do it, feel free to change it" to every response.
- fullstackchris 4y agoSee my other comment with cntl+F / cmd+F. Based on the simple fact that despite its power, this is just another NLP model which can only do input / output, I believe the post to be mostly fabricated, or at best, an accumulation of multiple _hours_ spent deriving and compiling the best responses per each prompt.
- skytrue 4y agoI feel like people are forgetting that these models are non-deterministic. You can give it the exact same input and get a different response, so "testing" in this way doesn't work. That's also why (right now) automation is impossible. You aren't guaranteed an expected output.
- aix1 4y agoI wonder what's the source of non-determinism here? (During inference, I mean.)