> With general, or strong AI we only just barely have the beginnings of an idea of how to even do preliminary research on it. Maybe. Or maybe we're just on sma

> With general, or strong AI we only just barely have the beginnings of an idea of how to even do preliminary research on it. Maybe. Or maybe we're just on small change away from AGI. We could be, because we don't yet really know what's required and we may not ever know until after we've done it. That prospect should be terrifying. > It's far, far too early to start worrying about controls and management strategies for the end point of that research. No, because if you create AGI before we have some containment or safety protocols, then it may already be too late. Consider whether we should have researched biolab safety before we started experimenting on modifying pathogens in various ways. Doesn't that just seem blindingly brain-dead obvious? For some reason this clear and obvious conclusion just goes out the window when it comes to AI.