5 ms·

The NetHack Learning Environment

176 points by emigre 4y ago

atemerev 4y ago
Did it ascend already?
- deleted 4y ago
  [deleted]
- omoikane 4y ago
  Looks like this repository is mostly concerned with standardizing the API to make it easier for others to build agents. It did come with code for an example agent, not sure how advanced that one is. The attached example_run.gif ended with "Agent76001 killed by a gnome lord, 2019".
- LordNibbler 4y ago
  doesn't seem so [1] I think the maximum score we've sene so far is maybe something like 4,000 or 5,000. They descend down to dungeon level on average five or six sometimes luckily, going down even dungeon level 15 [1]: https://www.youtube.com/watch?v=oYSNXTkeCtw https://www.youtube.com/watch?v=oYSNXTkeCtw
  - CactusOnFire 4y ago
    In defense of the AI, that's about as good as the average player (and the average players is pretty skilled).
    - atemerev 4y ago
      Level 8 is about where sokoban starts? That's what nearly any beginner could do after a few days (or even hours) of playing.
      - Hackbraten 4y ago
        I’ve been playing for maybe 100 hours over the course of a decade, and have reached level 8 maybe once or twice. I just keep getting killed by some stupid ant or wolf or whatnot.
        ranbato 4y ago
        I've been playing on and off for 3 decades. Finally started winning when I used the iPhone and Android versions. Something about the UIs makes me better than that PC interface.
        atemerev 4y ago
        iNetHack2?
        ranbato 4y ago
        On iPhone, yes.
jmclnx 4y ago
Interesting, will have to check this out. BTW, tnnt is active now: https://www.hardfought.org/tnnt https://www.hardfought.org/tnnt
haolez 4y ago
I think it must be much more fun creating an AI to be the dungeon master in NetHack. The vanilla monster AI is very crude.
- sanxiyn 4y ago
  A large part of attraction of NetHack Learning Environment is availability of large human play dataset, including expert demonstrations. While I agree playing dungeon master sounds fun, that game lacks such data.
- zasdffaa 4y ago
  How do you feel such an AI would change the game - what would it add? TIA
  - mordechai9000 4y ago
    For one thing, you could make the combat more interesting and varied. The monster AI is pretty simple and predictable. Soldiers or orcs could communicate and coordinate, for instance. So instead of simply walking the shortest path to the player to be dispatched one at a time, they could harry the player, use ranged weapons, retreat strategically, cut off the player's retreat, etc. You could have something similar for tame monsters. It would change the gameplay significantly, and require careful consideration of game balance. I think it would be more of a whole new variant, rather than something to tack onto an existing version of the game. AI driven NPC interaction could also provide some amusement and make the game less predictable. You could give shopkeepers and other NPCs distinct personalities, where there behavior is driven by complex motivations.And I'm sure lots of other stuff.
    - anthk 4y ago
      Would the game still be playable under a 486?
      - mordechai9000 4y ago
        Possibly not. It would be a different game, though.
simne 4y ago
I wonder, when NetHack will incorporate crypto, so one could get some real money from monsters ;)
- Hackbraten 4y ago
  “The leprechaun pulls the rug out from under you.”
- fao_ 4y ago
  The real success of AI will be creating one that can run away with all of the money when their crypto ponzi-scheme is done.
Twirrim 4y ago
The first known full-auto bot ascension happened back in 2015. https://www.reddit.com/r/nethack/comments/2tluxv/yaap_fullauto_bot_ascension_bothack/ https://www.reddit.com/r/nethack/comments/2tluxv/yaap_fullau... Previously discussed: https://news.ycombinator.com/item?id=8990869 https://news.ycombinator.com/item?id=8990869 The code: https://github.com/krajj7/BotHack https://github.com/krajj7/BotHack It was very carefully written in Clojure, and the result is some beautiful and fairly self explanatory code. The bit that ties everything together to define the way the bot behaves: https://github.com/krajj7/BotHack/blob/master/src/bothack/bots/mainbot.clj https://github.com/krajj7/BotHack/blob/master/src/bothack/bo...
- Barrin92 4y ago
  well written Clojure code almost just reads like prose, love the language.
- heinrich5991 4y ago
  Permalink to GitHub: https://github.com/krajj7/BotHack/blob/70226b3c8ed12d29c64068aec0acc0ca71d57adf/src/bothack/bots/mainbot.clj https://github.com/krajj7/BotHack/blob/70226b3c8ed12d29c6406....
anthk 4y ago
I would like that applied to Slashem. Here's a good fork: https://github.com/BarclayII/slashem-up https://github.com/BarclayII/slashem-up It lacks the jedi patch but it's complete enough.

176 points by emigre 4y ago

atemerev 4y ago

Did it ascend already?

deleted 4y ago
[deleted]
omoikane 4y ago
Looks like this repository is mostly concerned with standardizing the API to make it easier for others to build agents. It did come with code for an example agent, not sure how advanced that one is. The attached example_run.gif ended with "Agent76001 killed by a gnome lord, 2019".
LordNibbler 4y ago
doesn't seem so [1] I think the maximum score we've sene so far is maybe something like 4,000 or 5,000. They descend down to dungeon level on average five or six sometimes luckily, going down even dungeon level 15 [1]: https://www.youtube.com/watch?v=oYSNXTkeCtw https://www.youtube.com/watch?v=oYSNXTkeCtw
- CactusOnFire 4y ago
  In defense of the AI, that's about as good as the average player (and the average players is pretty skilled).
  - atemerev 4y ago
    Level 8 is about where sokoban starts? That's what nearly any beginner could do after a few days (or even hours) of playing.
    - Hackbraten 4y ago
      I’ve been playing for maybe 100 hours over the course of a decade, and have reached level 8 maybe once or twice. I just keep getting killed by some stupid ant or wolf or whatnot.
      - ranbato 4y ago
        I've been playing on and off for 3 decades. Finally started winning when I used the iPhone and Android versions. Something about the UIs makes me better than that PC interface.
        atemerev 4y ago
        iNetHack2?
        ranbato 4y ago
        On iPhone, yes.

jmclnx 4y ago

Interesting, will have to check this out. BTW, tnnt is active now: https://www.hardfought.org/tnnt https://www.hardfought.org/tnnt

haolez 4y ago

I think it must be much more fun creating an AI to be the dungeon master in NetHack. The vanilla monster AI is very crude.

sanxiyn 4y ago
A large part of attraction of NetHack Learning Environment is availability of large human play dataset, including expert demonstrations. While I agree playing dungeon master sounds fun, that game lacks such data.
zasdffaa 4y ago
How do you feel such an AI would change the game - what would it add? TIA
- mordechai9000 4y ago
  For one thing, you could make the combat more interesting and varied. The monster AI is pretty simple and predictable. Soldiers or orcs could communicate and coordinate, for instance. So instead of simply walking the shortest path to the player to be dispatched one at a time, they could harry the player, use ranged weapons, retreat strategically, cut off the player's retreat, etc. You could have something similar for tame monsters. It would change the gameplay significantly, and require careful consideration of game balance. I think it would be more of a whole new variant, rather than something to tack onto an existing version of the game. AI driven NPC interaction could also provide some amusement and make the game less predictable. You could give shopkeepers and other NPCs distinct personalities, where there behavior is driven by complex motivations.And I'm sure lots of other stuff.
  - anthk 4y ago
    Would the game still be playable under a 486?
    - mordechai9000 4y ago
      Possibly not. It would be a different game, though.

simne 4y ago

I wonder, when NetHack will incorporate crypto, so one could get some real money from monsters ;)

Hackbraten 4y ago
“The leprechaun pulls the rug out from under you.”
fao_ 4y ago
The real success of AI will be creating one that can run away with all of the money when their crypto ponzi-scheme is done.

Twirrim 4y ago

The first known full-auto bot ascension happened back in 2015. https://www.reddit.com/r/nethack/comments/2tluxv/yaap_fullauto_bot_ascension_bothack/ https://www.reddit.com/r/nethack/comments/2tluxv/yaap_fullau... Previously discussed: https://news.ycombinator.com/item?id=8990869 https://news.ycombinator.com/item?id=8990869 The code: https://github.com/krajj7/BotHack https://github.com/krajj7/BotHack It was very carefully written in Clojure, and the result is some beautiful and fairly self explanatory code. The bit that ties everything together to define the way the bot behaves: https://github.com/krajj7/BotHack/blob/master/src/bothack/bots/mainbot.clj https://github.com/krajj7/BotHack/blob/master/src/bothack/bo...

Barrin92 4y ago
well written Clojure code almost just reads like prose, love the language.
heinrich5991 4y ago
Permalink to GitHub: https://github.com/krajj7/BotHack/blob/70226b3c8ed12d29c64068aec0acc0ca71d57adf/src/bothack/bots/mainbot.clj https://github.com/krajj7/BotHack/blob/70226b3c8ed12d29c6406....

anthk 4y ago

I would like that applied to Slashem. Here's a good fork: https://github.com/BarclayII/slashem-up https://github.com/BarclayII/slashem-up It lacks the jedi patch but it's complete enough.