3 ms·

I don’t understand why you would think current AI can do any of that. Current AI can’t even stop hallucinating.

pierat 3y ago
Because I was sub'ed to openAI until yesterday. And my experiments with it were pretty promising. I took the whole corpus of Magic the Gathering rules ( https://magic.wizards.com/en/rules https://magic.wizards.com/en/rules ) as a textfile, and fed it into 4.0 . parsed it in a few seconds. I was then able to send it cards from Gatherer (MtG card database), and then ask it pointed questions about multiple card interactions. I also compared it to what DCI judges have made ruling on as well, and matched 100%. It quite impressed me. I was thinking next is to give it the rules text, and a JSON of every card. And then ask for all combos. But I'd run out of response before it could.
- jfengel 3y ago
  Out of curiosity, did you try the same experiment without specifically training it on the MtG rules? Could it have all of that, including card interaction decisions, from its training data (sourced from the whole Internet)?
  - pierat 3y ago
    I only tried it after giving the URL of the rules. There's multiple rules documents, and I wanted to make sure to use the current rules. It might have given good results without explicit rules provided. Or it could have spouted garbage. I did however ask very pointed questions about timing and layers. The ones that had DCI judge writings matched 100% (could be overfit with matching these documents). And the ones not written about also appeared to be completely accurate as well, since it also cited the rules that it came to its decision. However the larger problem is that GPT4 has been degrading quite a bit recently. It also precipitated my decision to unsubscribe. And I'm not the only one to notice this https://news.ycombinator.com/item?id=36134249 https://news.ycombinator.com/item?id=36134249
- raincole 3y ago
  > But I'd run out of response before it could. So you used ChatGPT via the website. > I took the whole corpus of Magic the Gathering rules ( https://magic.wizards.com/en/rules https://magic.wizards.com/en/rules ) as a textfile, and fed it into 4.0 . parsed it in a few seconds. You mean the TXT file? ChatGPT(4) on the website literally can't comprehend it. It has much, much, much, much more tokens than ChatGPT(4) can take. So this particular example proved what your parent comment pointed out. You think AI can do something that it can't.

Because I was sub'ed to openAI until yesterday. And my experiments with it were pretty promising. I took the whole corpus of Magic the Gathering rules ( https://magic.wizards.com/en/rules https://magic.wizards.com/en/rules ) as a textfile, and fed it into 4.0 . parsed it in a few seconds. I was then able to send it cards from Gatherer (MtG card database), and then ask it pointed questions about multiple card interactions. I also compared it to what DCI judges have made ruling on as well, and matched 100%. It quite impressed me. I was thinking next is to give it the rules text, and a JSON of every card. And then ask for all combos. But I'd run out of response before it could.

jfengel 3y ago
Out of curiosity, did you try the same experiment without specifically training it on the MtG rules? Could it have all of that, including card interaction decisions, from its training data (sourced from the whole Internet)?
- pierat 3y ago
  I only tried it after giving the URL of the rules. There's multiple rules documents, and I wanted to make sure to use the current rules. It might have given good results without explicit rules provided. Or it could have spouted garbage. I did however ask very pointed questions about timing and layers. The ones that had DCI judge writings matched 100% (could be overfit with matching these documents). And the ones not written about also appeared to be completely accurate as well, since it also cited the rules that it came to its decision. However the larger problem is that GPT4 has been degrading quite a bit recently. It also precipitated my decision to unsubscribe. And I'm not the only one to notice this https://news.ycombinator.com/item?id=36134249 https://news.ycombinator.com/item?id=36134249
raincole 3y ago
> But I'd run out of response before it could. So you used ChatGPT via the website. > I took the whole corpus of Magic the Gathering rules ( https://magic.wizards.com/en/rules https://magic.wizards.com/en/rules ) as a textfile, and fed it into 4.0 . parsed it in a few seconds. You mean the TXT file? ChatGPT(4) on the website literally can't comprehend it. It has much, much, much, much more tokens than ChatGPT(4) can take. So this particular example proved what your parent comment pointed out. You think AI can do something that it can't.