3 ms·
I'm catching up on the GPT-* news, but its pretty interesting. "GPT-3 is the latest in a series of text-generating neural networks. The name GPT stands for Gen
by redm 6y ago
I'm catching up on the GPT-* news, but its pretty interesting.
"GPT-3 is the latest in a series of text-generating neural networks. The name GPT stands for Generative Pretrained Transformer, referencing a 2017 Google innovation called a Transformer which can figure out the likelihood that a particular word will appear with surrounding words. Fed with a few sentences, such as the beginning of a news story, the GPT pre-trained language model can generate convincingly accurate continuations, even including the formulation of fabricated quotes."
It sounds a lot like a fancy version of PageRank for words. The results are impressive though. Like Grammerly + PageRank.