3 ms·
It was not a "prove it" challenge. I'm pointing out that there's no known information theoretic constraint about the impossibility of frontier AI models being
by fooker 2mo ago
It was not a "prove it" challenge.
I'm pointing out that there's no known information theoretic constraint about the impossibility of frontier AI models being improved to fit/run on a small GPU.
Please do not make up plausible sounding science facts.
- jimbo808 2mo agoPlease do not assert I am making a claim I’m not making. Information-theoretic constraints exist. My comment does not require some specific, hard constraint to have been clearly defined, for my point to be valid. If I were to say you could put a motorcycle in my car’s trunk, it would be perfect valid for me to say there are space constraints that make your idea unlikely. The same is true in this discussion, even though I have not computed the exact dimensions of the motorcycle and my car’s trunk.
- fooker 2mo agoYour claim was about frontier intelligence and midrange consumer GPUs. That's a pretty specific constraint. Sure, there could be some point between a midrange consumer GPU and a pocket calculator where you can't fit enough 'intelligence'. But we really have no idea if the constraint is information theoretic or something completely different. Demonstrating that is the hard part, not finding the exact number of bits. Talking about motorcycles in car trunks is just lazy false analogy here.
- deleted 2mo ago[deleted]
- jimbo808 2mo agoThen I give up. Best of luck.