> But I think there's the potential for emergent behavior, where size has a quality in itself, that's already showing up with GPT-4. "Emergent behavior" remain

> But I think there's the potential for emergent behavior, where size has a quality in itself, that's already showing up with GPT-4. "Emergent behavior" remains an article of faith, like the second coming. May happen, sure, but we have no evidence or theory for it, and no examples in our own species or any other to make us confident that consciousness somehow "emerges" as a function of scale. > Nobody knows how these work... We know exactly how they work. We can't predict the output from the inputs, or get the model to explain its internals in terms that make sense to us, because it doesn't internally work with words and sentences. Not understanding something completely -- atomic bonds, neuron activity -- and not knowing how to get from there to immune response or consciousness doesn't imply magical potential, just our limited understanding.