3 ms·
>truly air-gapped environments I don't think people have given much thought about just how hard this would be for large AI models, that need super powerful har
by holbrad 11d ago
>truly air-gapped environments
I don't think people have given much thought about just how hard this would be for large AI models, that need super powerful hardware/cooling etc.
Are you going to air-gap your entire data center?
- vbezhenar 11d agoYou don't need data center for inference. Even largest models run on a single server. You need data center for training; or for serving millions of users. Evaluating the model is neither of those.
- speedgoose 11d agoWhy not?