4 ms·

Yes. I should clarify that I meant 500k keys used in a single m/r job. We needed to be able to run m/r over roughly 200 million keys at the time.

• nirvana 14y ago
  And it turns out you are misrepresenting the situation completely. You can run M/R over key sets in the billions of keys. It sounds like you've not organized your data at all. You're bashing a product here based on your lack of knowledge, not the products lack of capabilities.
  • dmpk2k 14y ago
    Based on what I've seen for some internal things, that's one claim I'd like to see support for. m/r on Riak has been an unmitigated disaster here for anything beyond incredibly trivial working sets.
  • aphyr 14y ago
    I've never seen a Riak MR job over more than 3 million keys complete, on a 6-node SSD cluster. It might be possible, but you'd have to throw a lot more HW at it than the comparable Hadoop setup.
  • heretohelp 14y ago
    I see you're irrationally proselytizing again. We just saw you over in the programming languages thread, now you're here, refusing to confront the reality of how broken M/R is in Riak. What monkey crawls around on your back to make you so confrontational and irrational?