3 ms·
With all the hype surrounding GPT-3, super interesting question. Yesterday I read an article listed in HN, stating that the brain process spacial information t
by mromanuk 6y ago
With all the hype surrounding GPT-3, super interesting question.
Yesterday I read an article listed in HN, stating that the brain process spacial information together with visual information.
I would like to know if a transformer model is capable of learning current context: Maybe using some other form of neural net combined with other Bidirectional Transformer. That would work as a chatbot engine, though.
- smusamashah 6y agoI found GPT-3 to be dumb. Great conversation artist, but dumb. When studying, I tried picking up this exact problem, add context in chatbots as a research topic and was advised by my professor to stay away from chatbots because he already tried it and found them super complex.