4 ms·
This hasn't been my experience. Pretty easy with AWS Bedrock
by blastro 1y ago
This hasn't been my experience. Pretty easy with AWS Bedrock
- paxys 1y agoAh yes, "self host" by using a fully Amazon-managed service on Amazon's servers. How would a US court ever access those logs?
- garyfirestorm 1y agoRun a vllm docker container. Yeah the assumption is you already know what hardware you need or you already have it on prem. Assuming this is ITAR stuff, you must be self hosting everything.