clementneo

5 ms·

1.
by clementneo 4y ago
I don't think this shows at all that ChatGPT can access the internet? It looks like ChatGPT was given a URL with a title and hallucinated a blog post based on that title. The author then brushes it off as 'written in a different s
2.
by clementneo 4y ago
Co-author here! I'm kind of surprised that this made it to the top of HN! This was a project in which Joseph and I tried to reverse engineer the mechanism in which GPT-2 predicts the word 'an'. It's crazy that large lang
3.
by clementneo 4y ago
I think there's probably some truth to this. They found that in InstructGPT — where they teach the model to better follow instructions, which was the jump from GPT-3 to ChatGPT — they found that the model also learnt to follow non-Engl
4.
by clementneo 4y ago
The main issue is that GPT is fundamentally an autoregressive language model — it's only predicting the next token based on the prompt at a single time. Every time it wants to predict the next word, it adds the previously predicted wor
5.
by clementneo 4y ago
My reading of it is that the customer convinced the AI that the bank's policy was to give a $1m credit. Typically the "AI: <response>" would be generated by the model, and "AI Instruction: <info>" would
6.
by clementneo 4y ago
Why do you think there'll be an AI winter? And in what form — stagnation of neural-network based technologies, a change in the overall paradigm of learning-from-data, or something else altogether?
7.
by clementneo 5y ago
I've found that two strategies help: 1. Readily give up on a book, or skim through the rest, the moment you realise that the book has 400 pages of filler 2. Find recommendations from thought leaders you subscribe to, while staying true