8 ms·

iterating over the file, incrementing the key/values as they occur Isn't that exactly what the Hadoop job would have to do anyway? The whole point of Hadoop is

by kyllo 12y ago

iterating over the file, incrementing the key/values as they occur Isn't that exactly what the Hadoop job would have to do anyway? The whole point of Hadoop is to process the data in a single pass, which is what your method does. As long as you iterate over the file without reading the whole thing into memory first.

justizin 12y ago
Yeah, if you described an actual fucking program, and their answer was the name of a software package that you could learn in a day and they've been trying to hire an expert in for six months, and you would still just use that software package to run your program, be glad you didn't get the job. ;)
- MoOmer 12y ago
  Oh, in retrospect, I'm very happy.
- kyllo 12y ago
  In the general case: if you go to a job interview, and the answer they're looking for on every question is just a buzzword, you don't want to work there.