3 ms·

Being in the industry it's actually quite the opposite. OpenAI had a first mover advantage. ChatGPT has a good interface and GPT4 still leads on many benchmark

Being in the industry it's actually quite the opposite. OpenAI had a first mover advantage. ChatGPT has a good interface and GPT4 still leads on many benchmarks. But it continues to get worse and worse and others are catching up with significantly lower parameter counts. Their moat is shrinking very quickly. Llama2 is an open source meta model, btw. Anyscale's ray makes it much easier to leverage the super fast pace of development in the OSS community (or released by large companies as OSS).

ldjkfkdsjnv 3y ago
I also work on FAANG NLP research teams. I'm just saying that anyscale is now competing with AWS. Supposedly their moat is shrinking, Google has yet to release a model that competes with GPT-4. Anyone using these models on a daily basis is not impressed with Llama 2, and cannot build useful systems with it, aside from a narrow vertical.
- Hermitian909 3y ago
  Seeing this right now on the product side. I can't give away untuned GPT3.5, much less sell it. GPT4 is the absolute floor for what I can sell without setting up a pipeline.
- alfalfasprout 3y ago
  > Anyone using these models on a daily basis is not impressed with Llama 2 Being at a FAANG adjacent company working with these models on a daily basis, Llama2 is more than sufficient for a large number of use cases. It ultimately depends what exactly you're looking for. Exposing the LLM directly as a chat interface to users? Then yeah, in many cases it won't feel sufficient. Using it for search, summarization, moderation, etc.? Then it's often more than capable. FWIW GPT-4 is not one single model as you're aware and it evolves over time. In our experience it has objectively degraded in quality over time. As for anyscale, ultimately it's more like databricks (and funny enough lots of ex databricks folks there). Anyone can just run hosted spark. Databrick's ecosystem has set them apart and it looks like that's what anyscale is building towards.

ldjkfkdsjnv 3y ago

I also work on FAANG NLP research teams. I'm just saying that anyscale is now competing with AWS. Supposedly their moat is shrinking, Google has yet to release a model that competes with GPT-4. Anyone using these models on a daily basis is not impressed with Llama 2, and cannot build useful systems with it, aside from a narrow vertical.

Hermitian909 3y ago
Seeing this right now on the product side. I can't give away untuned GPT3.5, much less sell it. GPT4 is the absolute floor for what I can sell without setting up a pipeline.
alfalfasprout 3y ago
> Anyone using these models on a daily basis is not impressed with Llama 2 Being at a FAANG adjacent company working with these models on a daily basis, Llama2 is more than sufficient for a large number of use cases. It ultimately depends what exactly you're looking for. Exposing the LLM directly as a chat interface to users? Then yeah, in many cases it won't feel sufficient. Using it for search, summarization, moderation, etc.? Then it's often more than capable. FWIW GPT-4 is not one single model as you're aware and it evolves over time. In our experience it has objectively degraded in quality over time. As for anyscale, ultimately it's more like databricks (and funny enough lots of ex databricks folks there). Anyone can just run hosted spark. Databrick's ecosystem has set them apart and it looks like that's what anyscale is building towards.