dsacco

107 ms·

841.
by dsacco 9y ago
> if your IPs are in a contiguous /25 They're not. > To avoid a block, you need a list of good socks5 proxies No; furthermore, that leaks your data to a third party and introduces significant latency.
842.
by dsacco 9y ago
I have Verizon Fios set up as a business account to my home. However that bandwidth is for SAN to workstation data processing and analysis. There's only half a gigabit of external internet bandwidth, but I have hundreds of terabytes of
843.
by dsacco 9y ago
Yes, whenever I'm looking for a source to crawl I prefer mobile applications for precisely this reason. Request signing and certificate pinning are an upfront annoyance, but the maintainability is far higher.
844.
by dsacco 9y ago
Tor would introduce pretty intolerable latency into a professional data crawling setup.
845.
by dsacco 9y ago
To be honest (and speaking from experience), the only thing that would actually make life hard for a scraper is the last suggestion. I've never personally dealt with that, which is the only reason why I concede it. Machine generated HT
846.
by dsacco 9y ago
No, that analogy can't be applied in reverse. You're right that placing the burden of proof on the positive assertion is a dialectic oversimplification. But the specific claim, "A living creature cannot be as big as a galaxy&
847.
by dsacco 9y ago
Sure. I don't sell data but I'm happy to talk shop or help with interesting research projects.
848.
by dsacco 9y ago
> If you want to run a few hundred parallel spider processes with full browser in each, it's neither easy nor cheap anymore. It takes a lot more resources than running it headless, plus adds a significant overhead to automate and c
849.
by dsacco 9y ago
This is harder to do than you think. An industrious developer who works on these things will quickly notice that their distributed crawler has started failing, look through logs and ultimately identify the problem. Then they'll switch
850.
by dsacco 9y ago
> Hotel and airline websites, for example, are pummeled with scrapers wanting pricing and availability info. Yes, and they make it very cumbersome to discourage it. I've successfully written scrapers for airlines. It's signif
851.
by dsacco 9y ago
Interesting. I've done a lot of scraping and I never did this. Do you have a treatise that explains how it's done? I've actually been experimenting with headless Chrome recently because I like it more than PhantomJS. Practica
852.
by dsacco 9y ago
> A deficit of about 4000 calories a week is healthy for a loss of about a pound. There isn't really a hard and fast rule here, it depends on the person. If you are obese enough, you can engage in an extended fast with no food wha
853.
by dsacco 9y ago
Fair enough, thanks for providing that info.
854.
by dsacco 9y ago
Don't you just hate that?
855.
by dsacco 9y ago
I'm a little confused by what you mean. I'm not a nutritionist, but I am very active in both running and weight lifting (in other words, I have a lot of personal results, but take my opinions as qualified observations, not educate
856.
by dsacco 9y ago
Piggybacking on this to +1 the sentiment as another "security person": I literally do not go to Black Hat or Defcon because I don't like Vegas. It's a minor networking hit for me, but a total win otherwise (and I can mak
857.
by dsacco 9y ago
Cardio on its own is very sustainable.
858.
by dsacco 9y ago
> The chat feature has existed for a short while, too, which deserves more fame as being an e2e encrypted multi-device IM system that isn't tied to your phone number. On the other hand, it doesn't feature forward secrecy.
859.
by dsacco 9y ago
> What are you talking about: http://cr.yp.to/antiforgery/cachetiming-20050414.pdf Read that paper again. Cache timing attacks (and more generally timing attacks) are a subset of side channel attacks, which are n
860.
by dsacco 9y ago
To briefly expand on this (good) comment: In cryptography, the output of an algorithm is far less important than how that output was generated (with very precise specificity). Crypto code requires far more heavy lifting in the "how&quo
861.
by dsacco 9y ago
That's great, but that's not what I'm telling you. I'm telling you not to develop and deploy them with human passengers, in a production environment, on a trip to orbit. If you get collaboration from professionals with s
862.
by dsacco 9y ago
Depending on the algorithm: yes. I'm not saying all algorihms that are widely used and well known are extremely unlikely to be broken. I would happily bet $10,000 that AES will not be broken in the next ten years. I'd make the sam
863.
by dsacco 9y ago
I'm not aware of academic studies on the subject (I think that would be hard to do, because it's virtually impossible to know how many proprietary algorithms exist, how many are trivially breakable and how many have been broken).
864.
by dsacco 9y ago
It's not thought policing. Would you consider us adamantly telling you not to develop and deploy your own rockets or medical software without significant expertise and third party review to be "thought policing"? Furtherm
865.
by dsacco 9y ago
But is the code you're speaking of the security-specific code, or the network-specific code? If you attack a networking protocol, what are you attacking if not the associated cryptography? A networking protocol without any cryptography
866.
by dsacco 9y ago
Right, that observation is correct on the surface. But the reason why that's almost never done is because the goal of a cryptographic algorithm is to contribute enough safety margin on its own. Instead of encrypting twice, it's be
867.
by dsacco 9y ago
I'm sorry, I don't understand what you're trying to say. Can you clarify? What I am trying to say is that you gain nothing by, say, implementing your own encryption algorithm, using it on a plaintext, then encrypting the resu
868.
by dsacco 9y ago
Okay, what exactly is the claim you'd like me to argue with? That Bruce Schneier was a hobbyist when he developed any of his cryptographic algorithms? He wasn't, and more importantly that misses the point since those algorithms we
869.
by dsacco 9y ago
That is not rolling your own crypto. Rolling your own would be relying on your custom construction, not double encrypting and relying on the known construction for safety. ...Furthermore I'm confused as to why someone would do that. If
870.
by dsacco 9y ago
Can you clarify what you mean by "practical"?

More ›