5 ms·

What is the SQL query for: “What was the name of the guy, you know from that consulting company like Deloitte but the other one, who worked on the design for so

What is the SQL query for: “What was the name of the guy, you know from that consulting company like Deloitte but the other one, who worked on the design for some authentication system last year with Dick?” I’ve seen LLMs find matches for queries like this, even if “Dick” is a nickname for “Richard”. An awful lot of business questions are in this category and neither relational theory nor full text search is useful to solve such problems. An LLM coupled with a vector database could solve this, and provide entire new categories of products instead of a sub-standard substitute for an existing product.

photochemsyn 4y ago
An LLM might also create a meta-analysis questioning the value of the basic assumptions involved in the desirability of creating 'entirely new categories of products' - which, if you look at the history of financial products invented in the United States over the past 40 years, has some validity. When Elon Musk et al. talk about 'slowing down AI' that's the kind of thing that seems to concern them. What if AI could make a convincing argument for unionization at Tesla and the institution of a VW-style system of corporate management? Very frightening, I guess...
- dragonwriter 4y ago
  > When Elon Musk et al. talk about 'slowing down AI' that's the kind of thing that seems to concern them. No, Musk’s concern is just that his AI venture is starting out behind, so slowing down AI lets him catch up.
  - cubefox 4y ago
    How come you make such a disingenuous statement? He has warned about AI risk for 10 years. https://www.cnet.com/science/elon-musk-we-are-summoning-the-demon-with-artificial-intelligence/ https://www.cnet.com/science/elon-musk-we-are-summoning-the-... https://www.lesswrong.com/posts/kzHJ5BRhgkj9CSQ3N/musk-on-agi-timeframes https://www.lesswrong.com/posts/kzHJ5BRhgkj9CSQ3N/musk-on-ag... https://www.forbes.com/sites/ericmack/2015/01/15/elon-musk-puts-down-10-million-to-fight-skynet/ https://www.forbes.com/sites/ericmack/2015/01/15/elon-musk-p... https://www.youtube.com/watch?v=9jkRcrM6XKA https://www.youtube.com/watch?v=9jkRcrM6XKA https://twitter.com/elonmusk/status/1647601906087329794 https://twitter.com/elonmusk/status/1647601906087329794
    - cyphereal 3y ago
      Sure he warned of dangers, but also invested heavily in AI for autonomous driving by hiring DL researchers ("a million robot taxis by 2020"). He also invested in OpenAI until he had a falling out about who would be in charge of the company. He recently founded X.AI, which is supposedly also building generative AI. Everyone sees danger, but many, including Musk, are forging ahead.
    - kaba0 3y ago
      He is a scam artist with zero knowledge on anything. Just ignore him entirely.
      - cubefox 3y ago
        Sure, zero knowledge, and Tesla and SpaceX were just accidents. Got it.
        kaba0 3y ago
        Both were existing companies bought up by him, with the "founder" title included. Also, paying salaries for talent is very different from having said talent oneself. He has no expert knowledge on anything, one might have thought that at least he is good at programming (paypal), but look at twitter, he ain't good even at that.
        cubefox 3y ago
        Sure. So Tesla and SpaceX got big by complete accident.
moffkalast 4y ago
> LLM coupled with a vector database Speaking of that, has anyone shown a convincing demo of that working at all yet, or is it just hype? I've seen one short clip of allegedly working in long term memory with it, but the reliability could've been anything from zero to one.
drpixie 4y ago
> I’ve seen LLMs find matches for queries like this, even if “Dick” is a nickname for “Richard”. An awful lot of business questions are in this category and neither relational theory nor full text search is useful to solve such problems. Question - have you seen an LLM that can answer queries like this correctly and consistently, for a range of natural inputs? The ones I've seen often produce correct answers, but likely often produce apparently correct but wrong answers, and often produce garbage. For those systems, we've just changed the human's work from "write a query" to "filter the correct answers from the garbage" :(
- idopmstuff 3y ago
  Yes, provided the answer for the question is in context, not training. If you feed GPT4 a document and ask questions, it will virtually always answer those questions right. If you ask it for info in its training set, it will hallucinate sometimes. With Anthropic's 100k token context window, you can do a whole lot with this.
codebje 4y ago
Sure - once the hallucination problem is solved. Otherwise it'll just tell you the guy's name is Harry whether that's supported by the data available or not.
kaba0 3y ago
> provide entire new categories of products instead of a sub-standard substitute for an existing product. The question is, do people really want to give up deterministic execution or not. Sure, it might find that “Dick”, but will it reliably find the plain simple “Richard, order by date” query? Or will it sometimes omit/add a few additional records?
deleted 3y ago
[deleted]

photochemsyn 4y ago

An LLM might also create a meta-analysis questioning the value of the basic assumptions involved in the desirability of creating 'entirely new categories of products' - which, if you look at the history of financial products invented in the United States over the past 40 years, has some validity. When Elon Musk et al. talk about 'slowing down AI' that's the kind of thing that seems to concern them. What if AI could make a convincing argument for unionization at Tesla and the institution of a VW-style system of corporate management? Very frightening, I guess...

dragonwriter 4y ago
> When Elon Musk et al. talk about 'slowing down AI' that's the kind of thing that seems to concern them. No, Musk’s concern is just that his AI venture is starting out behind, so slowing down AI lets him catch up.
- cubefox 4y ago
  How come you make such a disingenuous statement? He has warned about AI risk for 10 years. https://www.cnet.com/science/elon-musk-we-are-summoning-the-demon-with-artificial-intelligence/ https://www.cnet.com/science/elon-musk-we-are-summoning-the-... https://www.lesswrong.com/posts/kzHJ5BRhgkj9CSQ3N/musk-on-agi-timeframes https://www.lesswrong.com/posts/kzHJ5BRhgkj9CSQ3N/musk-on-ag... https://www.forbes.com/sites/ericmack/2015/01/15/elon-musk-puts-down-10-million-to-fight-skynet/ https://www.forbes.com/sites/ericmack/2015/01/15/elon-musk-p... https://www.youtube.com/watch?v=9jkRcrM6XKA https://www.youtube.com/watch?v=9jkRcrM6XKA https://twitter.com/elonmusk/status/1647601906087329794 https://twitter.com/elonmusk/status/1647601906087329794
  - cyphereal 3y ago
    Sure he warned of dangers, but also invested heavily in AI for autonomous driving by hiring DL researchers ("a million robot taxis by 2020"). He also invested in OpenAI until he had a falling out about who would be in charge of the company. He recently founded X.AI, which is supposedly also building generative AI. Everyone sees danger, but many, including Musk, are forging ahead.
  - kaba0 3y ago
    He is a scam artist with zero knowledge on anything. Just ignore him entirely.
    - cubefox 3y ago
      Sure, zero knowledge, and Tesla and SpaceX were just accidents. Got it.
      - kaba0 3y ago
        Both were existing companies bought up by him, with the "founder" title included. Also, paying salaries for talent is very different from having said talent oneself. He has no expert knowledge on anything, one might have thought that at least he is good at programming (paypal), but look at twitter, he ain't good even at that.
        cubefox 3y ago
        Sure. So Tesla and SpaceX got big by complete accident.

moffkalast 4y ago

> LLM coupled with a vector database Speaking of that, has anyone shown a convincing demo of that working at all yet, or is it just hype? I've seen one short clip of allegedly working in long term memory with it, but the reliability could've been anything from zero to one.

drpixie 4y ago

> I’ve seen LLMs find matches for queries like this, even if “Dick” is a nickname for “Richard”. An awful lot of business questions are in this category and neither relational theory nor full text search is useful to solve such problems. Question - have you seen an LLM that can answer queries like this correctly and consistently, for a range of natural inputs? The ones I've seen often produce correct answers, but likely often produce apparently correct but wrong answers, and often produce garbage. For those systems, we've just changed the human's work from "write a query" to "filter the correct answers from the garbage" :(

idopmstuff 3y ago
Yes, provided the answer for the question is in context, not training. If you feed GPT4 a document and ask questions, it will virtually always answer those questions right. If you ask it for info in its training set, it will hallucinate sometimes. With Anthropic's 100k token context window, you can do a whole lot with this.

codebje 4y ago

Sure - once the hallucination problem is solved. Otherwise it'll just tell you the guy's name is Harry whether that's supported by the data available or not.

kaba0 3y ago

> provide entire new categories of products instead of a sub-standard substitute for an existing product. The question is, do people really want to give up deterministic execution or not. Sure, it might find that “Dick”, but will it reliably find the plain simple “Richard, order by date” query? Or will it sometimes omit/add a few additional records?

deleted 3y ago

[deleted]