3 ms·
Yeah. ChatGPT has no expertise at all, just a huge amount of knowledge. Because there are two parts in expertise: pure knowledge, and a set of weighed criteria
by astrobe_ 3y ago
Yeah. ChatGPT has no expertise at all, just a huge amount of knowledge.
Because there are two parts in expertise: pure knowledge, and a set of weighed criteria to evaluate things. This second part is what I think TFA calls "tacit" knowledge. This stuff is a job for neural networks, but more for Alpha0 than for ChatGPT - although it does probably that under the hood, but it's an expertise used to string together questions and answers. That's enough to give the illusion of expertise, but you still face the problem how evaluating that artificial expert. There are many reports that ChatGPT can be "slightly wrong" that only experts can really spot. You can have ChatGPT do your boilerplate code or bulk work if you are an expert in the field.
I personally think of this part of expertise as the expert's "intuition". This intuition is indeed sometimes difficult to communicate. Sometimes because it comes from various experiences, and describing those experiences in enough details would take far too long. Sometimes A just "feels" better than B because those criteria and weights are subconscious; pretty much like you apply a certain amount of force to lift an object because you have subconsciously evaluated its weight (either with material density and shape, or from memory because you've lifted similar things before) - and sometimes you are surprised because it is magnetized or it the box has been emptied.
However, my criteria to evaluate expertise is still how well the expert can explain something to me - that is, if they are good teachers. This also an unreliable proxy like the "vocab point" of TFA. Not everyone is a good teacher, and impostors or poseurs can make you feel like you understand when they are actually bullshitting you.
ChatGPT could be a good (enough) teacher that can help you becoming an expert (partly because of the fact checking work you'll have to do, something you normally don't have to do with an actual teacher), but ChatGPT as an expert, it is a no-no in my book.