4 ms·
That doesn't seem like a very large number. Are you sure?
by astrodust 15y ago
That doesn't seem like a very large number. Are you sure?
- mpd 15y agoYes. I should clarify that I meant 500k keys used in a single m/r job. We needed to be able to run m/r over roughly 200 million keys at the time.
- nirvana 15y agoAnd it turns out you are misrepresenting the situation completely. You can run M/R over key sets in the billions of keys. It sounds like you've not organized your data at all. You're bashing a product here based on your lack of knowledge, not the products lack of capabilities.
- dmpk2k 15y agoBased on what I've seen for some internal things, that's one claim I'd like to see support for. m/r on Riak has been an unmitigated disaster here for anything beyond incredibly trivial working sets.
- aphyr 15y agoI've never seen a Riak MR job over more than 3 million keys complete, on a 6-node SSD cluster. It might be possible, but you'd have to throw a lot more HW at it than the comparable Hadoop setup.
- heretohelp 15y agoI see you're irrationally proselytizing again. We just saw you over in the programming languages thread, now you're here, refusing to confront the reality of how broken M/R is in Riak. What monkey crawls around on your back to make you so confrontational and irrational?