numlocked

5 ms·

31.
by numlocked 6mo ago
COO of OpenRouter here. Thats right — we haven’t done it to date but we can’t have unlimited liabilities stacking up forever. At some point we will start expiring credits from accounts that have seen zero activity in over a year.
32.
by numlocked 7mo ago
I watched the video at the expecting one thing and finding something completely different. Remarkable — [0] watch the video in its entirety. Not what I thought when I read “staples to repair porcelain”. [0] intentional human use of an em-
33.
by numlocked 7mo ago
As per its own FAQ this plugin is out of date and doesn’t actually do anything incremental re:caching: > "Hasn't Anthropic's new auto-caching feature solved this?" > Largely, yes — Anthropic's automatic cachin
34.
by numlocked 9mo ago
At the risk of totally misunderstanding this...it seems to be exfiltration by the app developer, who already has access to all of these data sources and the data that the customer is inputting into the AI KYC app (in this example)...right?
35.
by numlocked 10mo ago
That is a way of doing that, but it's quite expensive computationally. There are some companies that can make it feasible [0], but it's often not a perfect process and different inference providers implement it different ways. [
36.
by numlocked 10mo ago
(I work at OpenRouter) If you send a PDF to our API we will: 1. Use native PDF parsing if the model supports it 2. Use this Mistral OCR model (we updated to this version yesterday) 3. UNLESS you override the "engine" param to use
37.
Response Healing: Reduce JSON defects by 80%+(openrouter.ai)
51 points by numlocked 10mo ago|47 comments
38.
by numlocked 10mo ago
I just learned that the site/magazine publishing this, Works in Progress, is owned by Stripe! I have no idea why, but the content is great so...thanks Stripe!
39.
by numlocked 10mo ago
Good read! The idea that these marvels of artistry were painted like my 10th birthday at the local paint-your-own-pottery store always seemed incongruous, at best. > Why, then, are the reconstructions so ugly? > ...may be that they ar
40.
by numlocked 10mo ago
We do this at openrouter and many apps use exactly that pattern!
41.
by numlocked 10mo ago
(I work at OpenRouter) Certainly for individual developers / hobby projects that's the primary value prop; super easy access to all of the models. But there's a lot more functionality that becomes relevant when building in
42.
by numlocked 10mo ago
(I work at OpenRouter) We add about 15ms of latency once the cache is warm (e.g. on subsequent requests) -- and if there are reliability problems, please let us know! OpenRouter should be more reliable as we will load balance and fall bac
43.
Is implicit caching prompt retention?(openrouter.ai)
6 points by numlocked 11mo ago|0 comments
44.
LLM Provider Variance: Introducing Exacto(openrouter.ai)
3 points by numlocked 1y ago|0 comments
45.
by numlocked 1y ago
(OpenRouter COO here) We are starting to test this and verify the deployments. More to come on that front -- but long story short is that we don't have good evidence that providers are doing weird stuff that materially affects model ac
46.
by numlocked 1y ago
I hear you, but the article is talking specifically about "embeddings as a product" -- not the embeddings that are within an LLM architecture. It starts: > As a quick review, embeddings are compressed numerical representations
47.
by numlocked 1y ago
I don’t quite understand. The article says things like: “With the constant upward pressure on embedding sizes not limited by having to train models in-house, it’s not clear where we’ll slow down: Qwen-3, along with many others is already at
48.
by numlocked 1y ago
Hi folks -- I'm Chris from OpenRouter. This one hurts. We're back, but our database was down for about 45 minutes, which caused user and credit lookups to fail, and took down the API. We are investigating why, and of course going
49.
by numlocked 1y ago
(I work at OpenRouter) We have a simple model comparison tool that is not-at-all-obvious to find on the website, but hopefully can help somewhat. E.g. https://openrouter.ai/compare/qwen/qwen3-coder/moonshotai&
50.
by numlocked 1y ago
(I work at OpenRouter) We have solved this problem by working with the providers to implement a prices and models API that we scrape, which is how we keep our marketplace up to date. It's been a journey; a year ago it was all happening
51.
by numlocked 1y ago
Hi - I'm the COO of OpenRouter. In practice we don't expire the credits, but have to reserve the right to, or else we have a uncapped liability literally forever. Can't operate that way :) Everyone who issues credits on a p
52.
by numlocked 1y ago
(Caveat on this comment: I'm the COO of OpenRouter. I'm not here to plug my employer; just ran across this and think this suggestion is helpful) Feel free to give OpenRouter a try; part of the value prop is that you purchase credi
53.
by numlocked 2y ago
Thank you for the kind words and email received!
54.
by numlocked 2y ago
I’m a bit late here - but I’m the COO of OpenRouter and would love to help out with some additional credits and share the project. It’s very cool and more people could be able to check it out. Send me a note. My email is cc at OpenRouter.ai
55.
by numlocked 2y ago
We don’t particularly want our customers’ data :)
56.
by numlocked 2y ago
COO of OpenRouter here. We are simply stating the WE can’t vouch for the behavior of the upstream provider’s retention and training policy. We don’t save your prompt data, regardless of the model you use, unless you explicitly opt-in to l
57.
by numlocked 2y ago
Is this the Will Brown talk you are referencing? https://www.youtube.com/watch?v=JIsgyk0Paic
58.
by numlocked 2y ago
Ohh, that is lovely. I had not seen it. Black does seemingly nothing wrong and is just in a world of hurt by the 12th move.
59.
by numlocked 2y ago
I have no insight but boy oh boy is this funny and well written. Like prime Dave Barry [0]. [0] https://www.davebarry.com/columns/how-to-make-board.php
60.
by numlocked 2y ago
Minor -- the date on the Riot Games video "stop point" is likely wrong. It says 2024, but based on the timeline it should be 2023.

More ›