2 ms·

Using R1 with Perplexity has impressed me in a way that none of the previous models have, and I can't even figure out if it's actually R1, seems likely that its

Using R1 with Perplexity has impressed me in a way that none of the previous models have, and I can't even figure out if it's actually R1, seems likely that its a 70B-llama distillation since that's what AWS offers on Bedrock but from what I can find Perplexity does have their own H100 cluster through Amazon so it's feasible they could be hosting the real thing? But I feel like they would brag about that achievement instead of being coy and simply labeling "Deepseek R1 - Hosted in US"

Szpadel 2y ago
I played with their model, and I want able to make him follow any instructions, it looked like it just reads first message and ignore rest of the conversation. not sure if they is bug with oupenrouter or model, but I was highly disappointed. from way how it thinks/responds looks like it's one of destinations , likely llama one I also suspect that many of free/cheap providers also serve llama instead of real R1
- jazzyjackson 2y ago
  I did notice it switched models on me once after the first message! Have to make sure the "Pro" dropdown is selected R1 each message. I've had a detailed back and forth where I pasted python tracebacks to have R1 rewrite the code and came away very impressed [0]. Unfortunately saved conversations don't retain the thought-process so you can't see how it debugged its own error where numpy and pandas weren't playing along. I got my result of 283 zip codes that cover most of the 50 states with a hundred mile radius from each zip, plus a script to draw a map of the result [1]. (Later R1 helped me write a script to crawl dealership addresses using this list of zips and a "locate dealers" JSON endpoint left open) [0] https://www.perplexity.ai/search/how-can-i-construct-a-list-of-xXivIjwSRE.CN3ct2S2MKg https://www.perplexity.ai/search/how-can-i-construct-a-list-... [1] https://imgur.com/BhPMCfO https://imgur.com/BhPMCfO
coder543 2y ago
> seems likely that its a 70B-llama distillation since that's what AWS offers on Bedrock I think you misread something. AWS mainly offers the full size model on Bedrock: https://aws.amazon.com/blogs/aws/deepseek-r1-models-now-available-on-aws/ https://aws.amazon.com/blogs/aws/deepseek-r1-models-now-avai... They talk about how to import the distilled models and deploy those if you want, but AWS does not appear to be officially supporting those.
- jazzyjackson 2y ago
  Aha! Thanks that's what I was looking for, I ended up on the blog of how to import custom models, including deepseek distills https://aws.amazon.com/blogs/machine-learning/deploy-deepseek-r1-distilled-llama-models-with-amazon-bedrock-custom-model-import/ https://aws.amazon.com/blogs/machine-learning/deploy-deepsee...

Szpadel 2y ago

I played with their model, and I want able to make him follow any instructions, it looked like it just reads first message and ignore rest of the conversation. not sure if they is bug with oupenrouter or model, but I was highly disappointed. from way how it thinks/responds looks like it's one of destinations , likely llama one I also suspect that many of free/cheap providers also serve llama instead of real R1

jazzyjackson 2y ago
I did notice it switched models on me once after the first message! Have to make sure the "Pro" dropdown is selected R1 each message. I've had a detailed back and forth where I pasted python tracebacks to have R1 rewrite the code and came away very impressed [0]. Unfortunately saved conversations don't retain the thought-process so you can't see how it debugged its own error where numpy and pandas weren't playing along. I got my result of 283 zip codes that cover most of the 50 states with a hundred mile radius from each zip, plus a script to draw a map of the result [1]. (Later R1 helped me write a script to crawl dealership addresses using this list of zips and a "locate dealers" JSON endpoint left open) [0] https://www.perplexity.ai/search/how-can-i-construct-a-list-of-xXivIjwSRE.CN3ct2S2MKg https://www.perplexity.ai/search/how-can-i-construct-a-list-... [1] https://imgur.com/BhPMCfO https://imgur.com/BhPMCfO

coder543 2y ago

> seems likely that its a 70B-llama distillation since that's what AWS offers on Bedrock I think you misread something. AWS mainly offers the full size model on Bedrock: https://aws.amazon.com/blogs/aws/deepseek-r1-models-now-available-on-aws/ https://aws.amazon.com/blogs/aws/deepseek-r1-models-now-avai... They talk about how to import the distilled models and deploy those if you want, but AWS does not appear to be officially supporting those.

jazzyjackson 2y ago
Aha! Thanks that's what I was looking for, I ended up on the blog of how to import custom models, including deepseek distills https://aws.amazon.com/blogs/machine-learning/deploy-deepseek-r1-distilled-llama-models-with-amazon-bedrock-custom-model-import/ https://aws.amazon.com/blogs/machine-learning/deploy-deepsee...