Or train it to predict code in a code base conditioned on the rest of the code in that same code base. That way, when you condition it on your current code base

Or train it to predict code in a code base conditioned on the rest of the code in that same code base. That way, when you condition it on your current code base, it might be able to generate sensible completions that could actually be useful.