3 ms·
Million row Excel doc that you only need to do 2 mins worth of stuff to? I'm curious what your use case is, can it not be completely automated?
by fletchowns 10y ago
Million row Excel doc that you only need to do 2 mins worth of stuff to? I'm curious what your use case is, can it not be completely automated?
- continuational 10y agoThe task at hand could just be to answer a quick one-off question about the data. Not worth bothering the developers for that.
- sz4kerto 10y agoTaking a log file, grep, sed to extract some numbers and then create a graph that shows the distribution of those numbers (histogram). It was one-off, I could have used some command-line tools to do all of those but then I'd have spend an hour learning how gnuplot works, which I didn't have time for. I'm a developer, and that's exactly why my time is expensive -- automating everything doesn't always make sense.
- xapata 10y agoDepends on how often you do the task (and similar), of course. If it's frequently, then not learning a faster technique is getting stuck in a local optima.
- hendzen 10y agoFor this type of task I usually spin up an ipython/jupyter notebook and hammer something out with Pandas very quickly. It's an incredibly productive toolkit for quickly performing this type of task.