2 ms·
It might not be rigorous science but it's a cracker of a blog post. It shows a surprising ability of language models, code is provided and plenty of mystery is
by xyzzy123 4y ago
It might not be rigorous science but it's a cracker of a blog post.
It shows a surprising ability of language models, code is provided and plenty of mystery is left for the reader... which can be investigated by almost anyone for tens of dollars.
- mjburgess 4y agoBut is it an ability? I can't tell. What would a useless "random" algorithm find operating on these graphs as inputs? What would a useful one find? What would that be "useful" for? Is this system much closer to the useless or the useful? We cant tell. Without any explanation, we're left reading this blog post as a magic trick in the literal sense. Consider the rate at which it "uses edges that don't exist" -- this makes it not a graph traversal algorithm. So it is just exploting syntax in the input whose representation has some "graphlike" qualities which can be statistically exploited. Why is that interesting? I dont know. Is this a good system?
- xyzzy123 4y agoI don't know! That's why it's fun. (EDIT: I can safely say this isn't practically useful... but it's interesting in the same way as watching a cat try to fill out a tax return. I'm not surprised the cat does it badly, I'm surprised that it seems to be doing it at all, even if it's really a trick).