5 ms·
The entire company is based around the idea of providing metrics for one closed-source platform's API? Or is the "OpenAI application observability" just one par
by StablePunFusion 4y ago
The entire company is based around the idea of providing metrics for one closed-source platform's API? Or is the "OpenAI application observability" just one part of what the company does? Otherwise it seems like taking the "all eggs in one basket" to the extreme.
- snacktaster 4y agoIt seems pretty brittle to me also. And their solution is to actually _proxy_ OAI's API wholesale which doesn't seem like a very good idea and might not even be permitted.
- justintorre75 4y agoOpenAI is just the start to capture most of the market and iterate on some ideas first :). We are adding multiple providers soon. ~Stay tuned~
- meghan_rain 4y agoWhat providers apart from OpenAI exist?
- justintorre75 4y agoHere are a few... https://www.ai21.com/ https://www.ai21.com/ https://www.anthropic.com/ https://www.anthropic.com/ https://cohere.ai/ https://cohere.ai/ https://huggingface.co/bigscience/bloom https://huggingface.co/bigscience/bloom https://goose.ai/ https://goose.ai/ https://bard.google.com/ https://bard.google.com/ https://ai.facebook.com/blog/large-language-model-llama-meta-ai/ https://ai.facebook.com/blog/large-language-model-llama-meta...
- version_five 4y agoTo be fair, there are companies based on providing metrics for AWS, e.g. Vantage, so it's not surprising to see VCs making bets in this area
- VWWHFSfQ 4y agoAWS provides services and APIs to support that specific usage. This service is MITM'ing another company's API. I'm pretty sure AWS wouldn't tolerate that sort of thing.
- version_five 4y agoOne could think about it as consulting, but productized, on top of a service. Something like AWS is mind numbingly complicated. Amazon has solutions engineers but there's also a big 3rd party market. And some part of that market doesn't need fully bespoke solutions but can be well served by a SaaS that sits on top (of course entailing risk, but it's all risky). OpenAI isn't there yet, personally I'm bearish on generative AI and openAIs dominance, but they're the major player, and there's a version of the future where they dominate the landscape with a complex enterprise offering like AWS that leaves room for intermediaries. So it's not a bad idea to include bets on people who are building these intermediary products as part of a vc portfolio.
- aryamaan 4y ago(my understanding might in incorrect but) is it not how cloudflare prevents DDOS attack?
- 0xDEF 4y agoAWS is a whole other beast than the few dozen REST and SSE endpoints at OpenAI.
- gmaster1440 4y agoIt's a big basket.
- quadcore 4y ago"all eggs in one basket" to the extreme. You couldn't describe better what a startup must do.
- throwaway280382 4y agoI guess they are betting that openAI will be such a big platform that many companies will need this capability. Not a bad idea I guess
- gregschlom 4y ago"Solve one pain point for OpenAI's users, get some nice traction, get acquired by OpenAI in a couple of months" is probably the plan here. Not a bad one to turn a quick profit.
- jacquesm 4y agoDo you think OpenAI is not logging their users' interactions already?
- CGamesPlay 4y agoThey certainly aren't exposing those logs back to the customer. There doesn't seem to be a way to see anything other than "total cost per day" in the dashboard. I like that Helicone allows me to see each request and export them all, so that I can use that to build my fine-tuning dataset.
- jacquesm 4y agoTrue, but why would they acquire a company for something they already have: the users and the logs. The tech is trivial.