4 ms·
Can this “expert in math” do binary addition? o1 falls apart after 10 bits, which is easily memorizable.
by in-pursuit 2y ago
Can this “expert in math” do binary addition? o1 falls apart after 10 bits, which is easily memorizable.
- fny 2y agoCan this "expert in math" write a function that performs binary addition?
- uncomplexity_ 2y agothis is the way. its internal mechanism is still statistical prediction of text in units of tokens. that math seemed lucid enough to be able to use functions.
- fny 2y agoIt’s like everyone suddenly forgot you can’t do O(n^2) compute in O(n) time.
- in-pursuit 2y agoBinary addition is O(n)
- fny 2y agoI meant this in the general case, not specifically binary addition. Also, returning an token by ChatGPT is technically an O(1) operation, so the same principle applies. Returning a computation answer of O(n_required_tokens) cannot be delivered in O(1) time without some sort of caching.
- in-pursuit 2y agoThe issue isn’t performing the specific addition. Rather, you’re asking o1 to take n-bits of data and combine them according to some set of rules. Isn’t that what these models are supposed to excel at, following instructions? Binary addition is interesting because the memorization space grows at 2^n, which is impossible to memorize for moderate values of n.