3 ms·

As someone who is about to be tasked with building this sort of infrastructure for a hospital system what would be your dream architecture? I hate IT hurdles an

• mlthoughts2018 8y ago
  The number one thing is to make containers a first class deployment and provisioning artifact. As long as dev teams can control their own containers, they will be able to do what they need no matter how arbitrary or assumption-breaking. Do not ever require dev teams to go through IT to get their chosen tools deployed to the right places or with the right resources provisioned. Never. This is the root of all evil with infra teams: if they see themselves or their mandate as being gatekeepers of provisioned resources, then dev teams have lost and you as a data scientist / ML engineer, you’ll never get your work done. As an ML engineer, I want to define the entire runtime and development environments of any analytics artifacts or web services that I create, and to change these environments as needed, as indicated by what’s required to get the job done. Let me define containers, hook them up in whatever CI tools are used, push and pull them from some internal container repository, and describe the configuration for the resources they need. Offer that as the contract to dev teams and then infra’s job is to maintain the underlying data center that physically supports running the containers and occasional hand holding for special exceptions, networking, secrets management, and cost tracking.
  • logosmonkey 8y ago
    Good, that's my current plan! I appreciate your input.
  • tixocloud 8y ago
    Very well said. I can’t stress the container environment enough not to mention the ability to control the toolset.