3 ms·
To people who are thinking about using AI for data analyses like the one described in the article: - I think it is much easier to just load the data into R, St
by drgo 3y ago
To people who are thinking about using AI for data analyses like the one described in the article:
- I think it is much easier to just load the data into R, Stata etc and interrogate the data that way. The commands to do that will be shorter and more precise and most importantly more reproducible.
- the most difficult task in data analysis is understanding the data and the mechanisms that have generated it. For that you will need a causal model of the problem domain. Not sure that AI is capable of building useful causal models unless they were somehow first trained using other data from the domain.
- it is impossible to reasonably interpret the data without reference to that model. I wonder if current AI models are capable of doing that, e.g., can they detect confounding or oversized influence of outliers or interesting effect modifiers.
Perhaps someone who knows more than I do on the state of current technology can provide a better assessment of where we are in this effort
- balls187 3y agoThat is effectively what the GPT4 based AI Assistant is doing. Except when I did it, it was python and pandas. You can ask it to show you the code it used to do it's analysis. So you can load the data into R/Python and google "how do I do xyzzzy" and write the code yourself, or use ChatGPT.
- drgo 3y agoso ChatGPT can build a causal model for a problem domain? How does it communicate that (using a DAG?)? It would be important for the data users to understand that model.