3 ms·
How are they 'streaming' the responses and 'pooling' the tokens? Do they have MacBooks in the US that run the queries and stream the outputs back to China?
by epsteingpt 4mo ago
How are they 'streaming' the responses and 'pooling' the tokens?
Do they have MacBooks in the US that run the queries and stream the outputs back to China?
- bagels 4mo agoThey probably asked claude how to do it.
- paxys 4mo agoWhy do you need macbooks? Just rent servers from any hosting provider.
- walrus01 4mo agoNot going to work for very long or at any scale coming from datacenter/hosting provider IPs. Google "residential proxies for sale" for the tip of an iceberg of how they snowshoe the traffic.
- paxys 4mo agoAs long as you stick to a single unique IP per account it isn't going to get flagged.
- walrus01 4mo agoRespectfully, no, that's not how it works. You think the people running anti-fraud and anti-bot measures don't have tools that know the specific ipv4 and ipv6 CIDR ranges of every ASN that they categorize as hosting/colo providers? And that's just as a basic first effort reject measure to prevent automation tools from using things designed for human-interactive use only. Go try to do many of these things from Cogent IP space and see how long your project lasts.
- awakeasleep 4mo agoSorry for being a newb here but are you saying Anthropic blocks people from running claude code on datacenter ip ranges? Or is the datacenter IP just one part of the picture?
- elwebmaster 4mo agoNonsense. Many if not all legit Claude users are using Claude Code inside their Cloud servers. How else would you use it anyway? For just local dev? That's so 2000 and late bro.
- walrus01 4mo agoNo, I'm not saying it's the exclusive and only measure (that would indeed be something we might see 20, 25 years ago), it's one of a myriad of discrete datapoints used to determine if an account is authentic or not. There's a lot of inauthentic coordinated automated systems these days along the general lines of scraping/crawling/social media manipulation/sockpuppetry that require running through residential proxies or proxies to places that don't look like datacenter IP space.
- Chu4eeno 4mo agoI assume they use residential proxies (tunneling in the background of crappy Android games) for the "last" hop.
- paxys 4mo agoEvery developer at my company uses their Claude Code subscription on an EC2 dev box. Plenty of other tech companies do the same. Heck nowadays people even install Claude Code directly on production servers in data centers and use it as an ops tool. None of this is a problem. Fraud and abuse detection is a lot more sophisticated than just checking an IP range.
- hanakuso 4mo agoWouldn’t it be funny if the same residential proxies allowing these labs to scrape the Internet is also what’s enabling these resellers?
- dannyw 4mo agoI use my Codex and Claude Code subs on like 4-6 different servers, ranging from AWS to Vultr to Linode etc. That’s a major and legitimate use case for developers, Anthropic can’t just block data center/hosting IPs because their actual customers use them on data center/hosting IPs.
- walrus01 4mo agoNow consider what will happen if your pattern of queries and context history triggers a pattern that makes it obvious it's some API key being used by multiple different entirely unrelated people on totally different things, or any other pattern of use that makes it obvious it's being used for distillation.
- dannyw 4mo agoTwo parts here. First, well-calibrated systems for detecting API compromise is a good thing (or good intent at least). Credential malware is exploding. Second, the challenge is that significant amount of genuine work — such as evals — seems practically impossible to distinguish from generating RLAIF outputs.
- c1sc0 4mo agoHey, if the bastards can use residential IPs to suck all information into their models with their crawlers, so can we!
- woctordho 4mo agoThere are lots of botnets providing home IPs.
- teravor 4mo ago> Do they have MacBooks in the US that run the queries and stream the outputs back to China? why would anyone do that? you do realize the laptop farm case was work computers? the answer to your question is containers/VMs + residential proxies
- globalnode 4mo agothat explains why theyre blocking me. i have privacy controls up high and they must think im a chinese residential proxy bot
- deleted 4mo ago[deleted]
- tristanj 4mo agoThe resellers route requests via one of thousands of Claude Max 5x accounts. When an account reaches its usage limit, they automatically switch to another account.
- kristofferR 4mo agoWhy would they use Max 5x instead of Max 20x, which is cheaper relatively speaking?
- tristanj 4mo agoYou're right, they're using the $200 Max plan, which I thought was the 5x plan. It's talked about in the article I linked.
- dannyw 4mo agoDon’t trust my experiences as fact since it’s a bit opaque, but I believe 20x only offers 4x the 5hr session limits. The weekly limit is still 2x, which is the same as the price increase.
- chews 4mo agoask your gpt how does openrouter work, then ask, how do proxies work.