Probably the biggest thing for Nethack DRL will be when datasets of human games allow for imitation-learning initialization, rather than learning from tabula ra

Probably the biggest thing for Nethack DRL will be when datasets of human games allow for imitation-learning initialization, rather than learning from tabula rasa (which even humans can't do). I asked them about that and apparently the existing telnet server datasets aren't usable but they have been working on getting usable game logs in the future: https://www.reddit.com/r/MachineLearning/comments/p88v9w/d_we_are_facebook_ai_researchs_nethack_learning/h9pb7p9/ https://www.reddit.com/r/MachineLearning/comments/p88v9w/d_w... As sessions pile up fast from all the active players, I expect at some point they'll be able to dump 50 or 100k human games, including by expert players, and that'll lead to a huge boost for DRL perf. And especially with those logged games, language models with retrieval will be useful: https://arxiv.org/abs/2206.05314#deepmind https://arxiv.org/abs/2206.05314#deepmind