The preferred technique seems to still be to train a base model on any data you can get your hands on, and add the "safety" alignment as a second training step.

The preferred technique seems to still be to train a base model on any data you can get your hands on, and add the "safety" alignment as a second training step. As long as that alignment is a small fine tuning compared to the initial training I wouldn't be worried about the model losing the ability to be uncensored.