4 ms·

This looks like a really good use case for LLMs. When you're small and starting out in person, record everything the dev team does -- meetings, whiteboads, pai

This looks like a really good use case for LLMs. When you're small and starting out in person, record everything the dev team does -- meetings, whiteboads, pairing sessions, etc. (yeah, creepy, but I'm in brainstorming mode) and then as you start to scale beyond the ability to "ask someone who knows" trail up an LLM to serve as the 24x7 lore master.

DaveSchmindel 3y ago
Ah, nice, like feeding a custom GPT everything that goes on at the company. That seems dangerous to me, and not in the typical LLM weariness way. Meetings can be messy, full of ambiguity, and "unsolved" at then end. If you feed a number of these experiences into an LLM, would its knowledge base be _that great_ at helping teach somebody about the company holding said meetings? I'd argue that in order for your LLM suggestion to be effective, the input to it would need to be human-written content. I.E: the knowledge that the OP is discussing. In that case, the human effort is still required up front.
- FeepingCreature 3y ago
  It would be interesting to see if you could train a LLM, given "<A> The foo is definitely xyfied" to exclusively answer "Well, at least two months ago, A thought that the foo was xyfied" rather than opine about foo directly.
haltist 3y ago
This is very much like my panoptic computronium cathedral™. I only need $80B to build it to achieve AGI. The AGI requires 24/7 surveillance for making optimal decisions because it needs access to as much information as possible. The second stage will require worshipers to ingest nanosensors so that even their bowel movements can be tracked and analyzed by the AGI. This is all for the benefit of those who are under constant surveillance in the cathedral.
- peteradio 3y ago
  Surely I wouldn't need to ingest anything to monitor my bowels, mightnt I simply insert a device up my ass?
  - haltist 3y ago
    Intriguing possibility.
  - thfuran 3y ago
    It's more robust to have multiple modalities, so you really ought to do both.
pavel_lishin 3y ago
A loremaster who will lie when they don't know the answer instead of saying, "I don't know".
- ycombinete 3y ago
  At which point it becomes the Dungeon Master
  - pavel_lishin 3y ago
    Funny joke and not inaccurate, but as a regular Dungeon Master, there have definitely been times where I'll say I don't know! For example: - "Sorry, I'm not sure right now how that class feature would work in this situation. For now, let's assume it works like X so we don't have to bog down the session to google the answers or scour the books, and I'll take the time to look it up later and make sure we do the correct thing going forward." - "You know what, I actually don't know what happens in this kingdom if the king is incapacitated, but still alive, I didn't think to prepare for that scenario! Um, roll me a history check, and if you get a 15 or higher, then you'll have heard of this happening before, and you tell us what happens!" - "Ok friends, I didn't expect you to just go north into the woods and build a raft to cross the river. I literally have nothing prepared for this scenario, so instead of me making up something bad, let's call the session for now, and I'll prepare something that I know will be fun for next time."
    - ycombinete 3y ago
      My dungeon master has done similar things in the past. I do love finding out, after a campaign, that a favourite npc or room was made up on the fly after we did something unexpected though! I especially like your second example. Rule of cool + added space for role play.

DaveSchmindel 3y ago

Ah, nice, like feeding a custom GPT everything that goes on at the company. That seems dangerous to me, and not in the typical LLM weariness way. Meetings can be messy, full of ambiguity, and "unsolved" at then end. If you feed a number of these experiences into an LLM, would its knowledge base be _that great_ at helping teach somebody about the company holding said meetings? I'd argue that in order for your LLM suggestion to be effective, the input to it would need to be human-written content. I.E: the knowledge that the OP is discussing. In that case, the human effort is still required up front.

FeepingCreature 3y ago
It would be interesting to see if you could train a LLM, given "<A> The foo is definitely xyfied" to exclusively answer "Well, at least two months ago, A thought that the foo was xyfied" rather than opine about foo directly.

haltist 3y ago

This is very much like my panoptic computronium cathedral™. I only need $80B to build it to achieve AGI. The AGI requires 24/7 surveillance for making optimal decisions because it needs access to as much information as possible. The second stage will require worshipers to ingest nanosensors so that even their bowel movements can be tracked and analyzed by the AGI. This is all for the benefit of those who are under constant surveillance in the cathedral.

peteradio 3y ago
Surely I wouldn't need to ingest anything to monitor my bowels, mightnt I simply insert a device up my ass?
- haltist 3y ago
  Intriguing possibility.
- thfuran 3y ago
  It's more robust to have multiple modalities, so you really ought to do both.

pavel_lishin 3y ago

A loremaster who will lie when they don't know the answer instead of saying, "I don't know".

ycombinete 3y ago
At which point it becomes the Dungeon Master
- pavel_lishin 3y ago
  Funny joke and not inaccurate, but as a regular Dungeon Master, there have definitely been times where I'll say I don't know! For example: - "Sorry, I'm not sure right now how that class feature would work in this situation. For now, let's assume it works like X so we don't have to bog down the session to google the answers or scour the books, and I'll take the time to look it up later and make sure we do the correct thing going forward." - "You know what, I actually don't know what happens in this kingdom if the king is incapacitated, but still alive, I didn't think to prepare for that scenario! Um, roll me a history check, and if you get a 15 or higher, then you'll have heard of this happening before, and you tell us what happens!" - "Ok friends, I didn't expect you to just go north into the woods and build a raft to cross the river. I literally have nothing prepared for this scenario, so instead of me making up something bad, let's call the session for now, and I'll prepare something that I know will be fun for next time."
  - ycombinete 3y ago
    My dungeon master has done similar things in the past. I do love finding out, after a campaign, that a favourite npc or room was made up on the fly after we did something unexpected though! I especially like your second example. Rule of cool + added space for role play.