5 ms·
Dedicated instances (and high price tags, like $1.5 million per year) are necessary for large corporations to feel safe about sending their proprietary/private
by riskneutral 4y ago
Dedicated instances (and high price tags, like $1.5 million per year) are necessary for large corporations to feel safe about sending their proprietary/private data to OpenAI, and to have performance/availablity SLAs in place if/when they start depending on OpenAI for critical workloads. Right now many companies are blocking access to OpenAI entirely because of the data privacy issues. I wouldn't be surprised if this "leak" is intentional and a way of getting feedback from the market on proposed product/pricing. I also wouldn't be surprised if some larger customers are knocking on OpenAI's door and demanding to run OpenAI's models on their own infrastructure to avoid sending any data outside their network.
- visarga 4y agoAbout $100K .. $200K are inference costs. They have a 10x markup.