3 ms·

No results for wizzwizz4 "GPT", although it does look like search results may be incomplete: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=Auth

by kalkin 2y ago

No results for wizzwizz4 "GPT", although it does look like search results may be incomplete: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=Author%3AWizzwizz4%20gpt&sort=byDate&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

wizzwizz4 2y ago
The "author:" part was just being treated as a keyword, and was restricting the results too much. I haven't found the comments I was looking for, but I have found Chain of Thought prompting, 11 months before it was cool (https://news.ycombinator.com/item?id=26063189 https://news.ycombinator.com/item?id=26063189): > Instruction: When considering the sizes of objects, you will calculate the sizes before attempting a comparison. > GPT-2 doesn't have a concept of self, so it constructs plausible in-character excuses instead. I also found the Great Translation Argument (see https://news.ycombinator.com/item?id=35530858 https://news.ycombinator.com/item?id=35530858 and https://news.ycombinator.com/item?id=35530855 https://news.ycombinator.com/item?id=35530855). And, apparently, I was still framing things in terms of the sci-fi nonsense in 2020, but I had the right ideas (https://news.ycombinator.com/item?id=22802105 https://news.ycombinator.com/item?id=22802105): > Corollary: you can't patch broken FAI designs. Reinforcement learning (underlying basically all of our best AI) is known to be broken; it'll game the system. Even if they were powerful enough to understand our goals, they simply wouldn't care; they'd care less than a dolphin. https://vkrakovna.wordpress.com/2018/04/02/specification-gaming-examples-in-ai/ https://vkrakovna.wordpress.com/2018/04/02/specification-gam... > And there are far too many people in academia who don't understand this, after years of writing papers on the subject. This criticism applies to RLHF, so it counts, imo. Not as explicit as my (probably unpublished, almost certainly embarrassing) wild ravings from 2018, but it's before 2024.

by kalkin 2y ago

wizzwizz4 2y ago

The "author:" part was just being treated as a keyword, and was restricting the results too much. I haven't found the comments I was looking for, but I have found Chain of Thought prompting, 11 months before it was cool (https://news.ycombinator.com/item?id=26063189 https://news.ycombinator.com/item?id=26063189): > Instruction: When considering the sizes of objects, you will calculate the sizes before attempting a comparison. > GPT-2 doesn't have a concept of self, so it constructs plausible in-character excuses instead. I also found the Great Translation Argument (see https://news.ycombinator.com/item?id=35530858 https://news.ycombinator.com/item?id=35530858 and https://news.ycombinator.com/item?id=35530855 https://news.ycombinator.com/item?id=35530855). And, apparently, I was still framing things in terms of the sci-fi nonsense in 2020, but I had the right ideas (https://news.ycombinator.com/item?id=22802105 https://news.ycombinator.com/item?id=22802105): > Corollary: you can't patch broken FAI designs. Reinforcement learning (underlying basically all of our best AI) is known to be broken; it'll game the system. Even if they were powerful enough to understand our goals, they simply wouldn't care; they'd care less than a dolphin. https://vkrakovna.wordpress.com/2018/04/02/specification-gaming-examples-in-ai/ https://vkrakovna.wordpress.com/2018/04/02/specification-gam... > And there are far too many people in academia who don't understand this, after years of writing papers on the subject. This criticism applies to RLHF, so it counts, imo. Not as explicit as my (probably unpublished, almost certainly embarrassing) wild ravings from 2018, but it's before 2024.