For a while there it was off by default, but I'm fairly sure it's back to being on out of the box on current machines. It's also now exposed through the UI: Set

For a while there it was off by default, but I'm fairly sure it's back to being on out of the box on current machines. It's also now exposed through the UI: Settings > Sound > Play sound on startup.