The CMB shows the universe at the point where its density became low enough that photons could move around freely. That's the furthest point that we can "see"

The CMB shows the universe at the point where its density became low enough that photons could move around freely. That's the furthest point that we can "see" if you required "seeing" to have to do with electromagnetic radiation. But there are other types of radiation that penetrate dense matter better: neutrinos and gravity waves. Right now it's "holy shit I saw one" for both kinds, so we're a long way off from doing any kind of imaging in those media. But if we ever manage detectors large enough and sensitive enough, we should be able to take "pictures" of the universe when it was even younger than when the CMB was released. Dense enough matter will stop neutrinos, so that signal will be further back, but not the bang itself. So far as we know, nothing stops gravity--so that signal ought to be... interesting. (Or at least, that's what Lee Smolin says in his book: Time Reborn)