4 ms·

Also feels like we are just waiting for someone to swoop in with a open source model like DeepSeek that wipes both of them out.

sour-taste 2y ago
Shouldn't deepseek have done that already?
- rtkwe 2y ago
  There's a lot of money riding on their being a lot of headroom left on LLM performance and usefulness. I personally have my doubts you can get their with the Chinese Room model of LLMs but that's where all the money and hype is riding.
- keithwhor 2y ago
  DeepSeek V3 is easily the best cost / performance non-reasoning model on the market but accessing it via API is not straightforward -- at least for people who want their model hosted in the US. For the layperson OpenAI / Anthropic are much more accessible. Some of OpenRouter's [0][1] providers seem bunk; their version is corrupted. Occasionally just get mangled outputs. Fireworks [2] is my best experience so far: their serverless API, haven't messed with custom deployments. Fast, performant, better than other models in its size category and less expensive. [0] https://openrouter.ai/deepseek/deepseek-chat:free https://openrouter.ai/deepseek/deepseek-chat:free [1] https://openrouter.ai/deepseek/deepseek-chat https://openrouter.ai/deepseek/deepseek-chat [2] https://fireworks.ai/models/fireworks/deepseek-v3 https://fireworks.ai/models/fireworks/deepseek-v3
AustinDev 2y ago
QwQ 32B has replaced Sonnet 3.7 for me for quick hack apps I write like. 'Service that converts youtube tutorial videos into step by step instructions with timestamp references for each step.' And I can run it locally!
- dchuk 2y ago
  Are you chatting with it directly or using it with a coding tool or IDE?
- radlad 2y ago
  For whatever reason, qwq on a Macbook under ollama & Open Web UI seems to often "stall out" for me. It just never reports it even started to answer. Have you experienced this at all? I don't have this issue with qwen2.5-coder, deepseek, etc.
whiplash451 2y ago
The product is much more than the model. Our hacker community is not a good proxy for the overall userbase.
- rowanseymour 2y ago
  Ok but where is the product? Aren't most people just using ChatGPT from a chat prompt like they can do with any other LLM?
  - deleted 2y ago
    [deleted]

sour-taste 2y ago

Shouldn't deepseek have done that already?

rtkwe 2y ago
There's a lot of money riding on their being a lot of headroom left on LLM performance and usefulness. I personally have my doubts you can get their with the Chinese Room model of LLMs but that's where all the money and hype is riding.
keithwhor 2y ago
DeepSeek V3 is easily the best cost / performance non-reasoning model on the market but accessing it via API is not straightforward -- at least for people who want their model hosted in the US. For the layperson OpenAI / Anthropic are much more accessible. Some of OpenRouter's [0][1] providers seem bunk; their version is corrupted. Occasionally just get mangled outputs. Fireworks [2] is my best experience so far: their serverless API, haven't messed with custom deployments. Fast, performant, better than other models in its size category and less expensive. [0] https://openrouter.ai/deepseek/deepseek-chat:free https://openrouter.ai/deepseek/deepseek-chat:free [1] https://openrouter.ai/deepseek/deepseek-chat https://openrouter.ai/deepseek/deepseek-chat [2] https://fireworks.ai/models/fireworks/deepseek-v3 https://fireworks.ai/models/fireworks/deepseek-v3

AustinDev 2y ago

QwQ 32B has replaced Sonnet 3.7 for me for quick hack apps I write like. 'Service that converts youtube tutorial videos into step by step instructions with timestamp references for each step.' And I can run it locally!

dchuk 2y ago
Are you chatting with it directly or using it with a coding tool or IDE?
radlad 2y ago
For whatever reason, qwq on a Macbook under ollama & Open Web UI seems to often "stall out" for me. It just never reports it even started to answer. Have you experienced this at all? I don't have this issue with qwen2.5-coder, deepseek, etc.

whiplash451 2y ago

The product is much more than the model. Our hacker community is not a good proxy for the overall userbase.

rowanseymour 2y ago
Ok but where is the product? Aren't most people just using ChatGPT from a chat prompt like they can do with any other LLM?
- deleted 2y ago
  [deleted]