3 ms·
It works really well for questions that have easy answers and that are asked a lot. It works less well when you have a question that doesn't have an obvious an
by marginalia_nu 3y ago
It works really well for questions that have easy answers and that are asked a lot.
It works less well when you have a question that doesn't have an obvious answer.
For fun, try 'How can I write to a Parquet file in Java without Hadoop?'. It will vacillate between giving answers that pull in hadoop dependencies, and nonsense that doesn't compile at all.
(here's a useful proper answer: https://stackoverflow.com/questions/59939309/read-local-parquet-file-without-hadoop-path-api https://stackoverflow.com/questions/59939309/read-local-parq...)
- Closi 3y agoIt also works well for questions that have easy/medium answers and aren’t asked a lot. Complex questions that involve things that aren’t well documented are obviously going to be harder for an LLM to answer, particularly when the LLM does not have a capability to test its own code.
- joebiden2 3y agoThat's ChatGPT-4's response to that question: https://chat.openai.com/share/72d490a9-2b2a-4120-9bb0-3a59d417a41e https://chat.openai.com/share/72d490a9-2b2a-4120-9bb0-3a59d4... I briefly checked if the mentioned dependencies exist (they do). Too late over here to actually try the code.
- marginalia_nu 3y agoMain.java:27:33 java: org.apache.parquet.io.OutputFile is abstract; cannot be instantiated Main.java:29:17 java: cannot access org.apache.hadoop.fs.Path class file for org.apache.hadoop.fs.Path not found It basically solves the problem by not importing hadoop dependencies (despite needing to), and hallucinating classes.