3 ms·

If a $200/month pro level is successful it could open the door to a $2000/month segment, and the $20,000/month segment will appear and the segregation of gettin

by j45 2y ago

If a $200/month pro level is successful it could open the door to a $2000/month segment, and the $20,000/month segment will appear and the segregation of getting ahead with AI will begin.

dr_kiszonka 2y ago
This is a significant concern for me too.
- j45 2y ago
  It's important to become early users of everything while AI is heavily subsidized. Over time, using open source model as well will get more done per dollar of compute and hopefully the gap will remain close.
  - fragmede 2y ago
    Question is if OpenAI is actually making money at $200/month.
    - j45 2y ago
      For funded startups, losing less can be a form of runway and capacity especially at the numbers they are spending.
    - vbezhenar 2y ago
      With o1-preview and $20 subscription my queries typically were answered in 10-20 seconds. I've tried $200 subscription with some queries and got 5-10 minutes answer time. Unless the load is substantially increased and I was just waiting in queue for computing resources, I'd assume that they throw a lot more hardware for o1-pro. So it's entirely possible that $200/month is still at loss.
johnisgood 2y ago
Agreed. Where may I read about how to set up an LLM similar to that of Claude, which has the minimum length of Claude's context window, and what are the hardware requirements? I found Claude incredibly useful.
- j45 2y ago
  Looking into running models locally, maybe a 405B parameter model sounds like the place to start. Once understood you could practice with a private hosted llm (run your own model) to tweak and get it dialled in per hour, and then make the leap.
  - wkat4242 2y ago
    And now you can get the 405b quality in a 70b according to meta. Costs really come down massively with that. I wonder if it's really as good as they say though.
deleted 2y ago
[deleted]
m3kw9 2y ago
Full blown agents but they have to really able to replace a semi competent, harder than it sounds especially for edge cases where a human can easily get past
- j45 2y ago
  Agents still need a fair bit of human input and design and tweaking.

by j45 2y ago

If a $200/month pro level is successful it could open the door to a $2000/month segment, and the $20,000/month segment will appear and the segregation of getting ahead with AI will begin.

dr_kiszonka 2y ago

This is a significant concern for me too.

j45 2y ago
It's important to become early users of everything while AI is heavily subsidized. Over time, using open source model as well will get more done per dollar of compute and hopefully the gap will remain close.
- fragmede 2y ago
  Question is if OpenAI is actually making money at $200/month.
  - j45 2y ago
    For funded startups, losing less can be a form of runway and capacity especially at the numbers they are spending.
  - vbezhenar 2y ago
    With o1-preview and $20 subscription my queries typically were answered in 10-20 seconds. I've tried $200 subscription with some queries and got 5-10 minutes answer time. Unless the load is substantially increased and I was just waiting in queue for computing resources, I'd assume that they throw a lot more hardware for o1-pro. So it's entirely possible that $200/month is still at loss.

johnisgood 2y ago

Agreed. Where may I read about how to set up an LLM similar to that of Claude, which has the minimum length of Claude's context window, and what are the hardware requirements? I found Claude incredibly useful.

j45 2y ago
Looking into running models locally, maybe a 405B parameter model sounds like the place to start. Once understood you could practice with a private hosted llm (run your own model) to tweak and get it dialled in per hour, and then make the leap.
- wkat4242 2y ago
  And now you can get the 405b quality in a 70b according to meta. Costs really come down massively with that. I wonder if it's really as good as they say though.

deleted 2y ago

[deleted]

m3kw9 2y ago

Full blown agents but they have to really able to replace a semi competent, harder than it sounds especially for edge cases where a human can easily get past

j45 2y ago
Agents still need a fair bit of human input and design and tweaking.