It's mostly because it's easier. No additional token necessary, No config, No Service discovery. For small models (less than 100MB), it's generally not an issue

It's mostly because it's easier. No additional token necessary, No config, No Service discovery. For small models (less than 100MB), it's generally not an issue to embed them directly in the image. However, if you're getting GB-size images with less than half of it related to the serving code and its library, then it's time to upgrade.