I would argue you're not gaining much by complicating that specific table structure, since that information is going to be stored in the layer_attributes table

I would argue you're not gaining much by complicating that specific table structure, since that information is going to be stored in the layer_attributes table where it naturally belongs. There may be several other attributes that can affect whether or not to load the resulting binary blob into memory.