3 ms·

I feel like from an information theory perspective there is a lower bound on how little we can write to get a sufficiently specific spec for the AI to generate

I feel like from an information theory perspective there is a lower bound on how little we can write to get a sufficiently specific spec for the AI to generate correct code. This example seems like almost as much work as just writing the code myself. I think English is just too fuzzy, maybe eventually we will get a language tailored to AI that will put more specific limits on the meanings of works. But then how is it all that different from Python?

blackbear_ 4y ago
> a lower bound on how little we can write to get a sufficiently specific spec for the AI to generate correct code. Interesting though. I believe a lower bound for the number of bits must be at least the log (in base 2) of the probability of such code to appear "in the wild", and larger if the training set is biased and/or the model not fully trained