3 ms·
I wonder if the MineRL (https://www.ijcai.org/proceedings/2019/0339.pdf https://www.ijcai.org/proceedings/2019/0339.pdf and minerl.io) dataset would be sufficie
by jamilton 2y ago
I wonder if the MineRL (https://www.ijcai.org/proceedings/2019/0339.pdf https://www.ijcai.org/proceedings/2019/0339.pdf and minerl.io) dataset would be sufficient to reproduce this work with Minecraft.
Any other similar existing datasets?
A really goofy way I can think of to get a bunch of data would be to get videos from youtube and try to detect keyboard sounds to determine what keys they're pressing.
- jamilton 2y agoAlthough ideally a follow up work would be something where there won’t be any potential legal trouble with releasing the complete model so people can play it. A similar approach but with a game where the exact input is obvious and unambiguous from the graphics alone so that you can use unannotated data might work. You’d just have to create a model to create the action annotations. I’m not sure what the point would be, but it sounds like it’d be interesting.