2 ms·
In what scenarios do you have to manually download and upload data. There are ingestion tools out there. It seems like automating tasks is painful. What kind of
by kmalhi 8y ago
In what scenarios do you have to manually download and upload data. There are ingestion tools out there. It seems like automating tasks is painful. What kind of tasks are those? I’m guessing all of this takes a lot of your time away from actual analysis
- ktpsns 8y agoYup, there are tools "for almost everything", but they must be flexible enough, then compatible to the machines used, and learned to use. For instance, in science, "grid computing" is popular to automate away the orchestration of files and codes between machines. But it's not always available and sometimes not applicable. I assume every workplace has an overhead part which keeps one from doing the actual work.
- kmalhi 8y agoDo you have to do the whole infrastructure setup yourself or do you get help from your engineering team?