3 ms·
This is pretty cool, it's snappy, it seems to work, but there's no way I trust it without a way to check the LLM's work.
by TOMDM 2y ago
This is pretty cool, it's snappy, it seems to work, but there's no way I trust it without a way to check the LLM's work.
- ipieter 2y agoYeah I just tried it with numbers I knew a bit and it seems totally made up. The generated chart showed a linear downwards trend while in reality there isn't one and the numbers seem way off.
- mritchie712 2y agoThis is a great point. It's easy to spin up an LLM data analysis demo, but it's really hard to trust the outputs. I think we've (https://www.definite.app/ https://www.definite.app/) done a decent job here. Once the LLM generates results, you can inspect the query all the way back to the source (SQL). https://www.youtube.com/watch?v=Nu2Tal3hm7s https://www.youtube.com/watch?v=Nu2Tal3hm7s
- caoxhua 2y agoUnless it's very "public common", otherwise, the numbers can be used for trustworthy work. In general, I think this is just for "fun play" most of the time.