3 ms·

Is that feasible? I was under the impression that fully training an LLM requires untold mountains of data, way more than a game dev company could reasonably cre

• c0redump 1y ago
  You are correct. The fact that so many people are saying “lol just train it on text about the game bro” reveals how little people understand how these models work, how they are trained, etc.
• com2kid 1y ago
  Microsoft's phi models are trained on a much smaller dataset. They generally aren't as amazing as the models that get talked about more, but they are more than enough to get the job done for npc lines in a game.
• whywhywhywhy 1y ago
  Personally I’d try fine tuning an existing one, can be done locally in an afternoon.