3 ms·
How is doing it server side a different challenge than something like google collab or any of those Jupyter notebook type services?
by cruffle_duffle 2y ago
How is doing it server side a different challenge than something like google collab or any of those Jupyter notebook type services?
- trillic 2y agoGoogle Collab are all individual VMs. It seems Anthropic doesn’t want to be in the “host a VM for every single user” business.
- donavanm 2y agoShared resources and multitenancy are how you get efficiency and density. Those are at direct odds with strict security boundaries. IME you need hardware supported virtualization for consistent security boundary of arbitrary compute. Linux namespaces (“containers”) and language runtime isolation are not it for critical workloads, see some of the early aws nitro/firecracker works for more details. I _assume_ the cases you mentioned may be more constrained, or actually backed by VM partitions per customer.
- deleted 2y ago[deleted]