"it's impressive for what it is, but ..." is probably a good way to describe chatGPT's performance for a lot of tasks - but what's interesting is the vast diver

"it's impressive for what it is, but ..." is probably a good way to describe chatGPT's performance for a lot of tasks - but what's interesting is the vast diversity in these tasks. I've asked it write me a few poems and it does much better than I could. I've asked it to write songs (including chord progressions, instrument/synth suggestions) for specific genres and it was OK, not great. I've seen people use it for fake maury transcripts, essays in the style of X, marketing copy, and as here, answer legal questions (which as far as I can tell it did far better than I could, not having any legal training whatsoever). chatGPT does seem quite a good (though unreliable and perhaps overconfident) generalist. I'm wondering how much better GPTs trained/fine tuned specifically for a given field - say, contract law - would do for that task.