3 ms·

You’re not using it right. LLM fundamentally don’t know s*t about this company’s exec team. Maybe some names are statistically close to the company name in vect

You’re not using it right. LLM fundamentally don’t know s*t about this company’s exec team. Maybe some names are statistically close to the company name in vector-space but no guarantee (as you discovered). The LLM won’t revolutionize search as it is today for factual queries. They’re Clippy 2.0. It’s great people are finding use for the models, but I wish this search story would be balanced out a bit. I was laid off recently, and I’m using the LLM to write a bunch of cover letters. I give it my resume, a blurb about the company and job and a bit about what I like about work, and it outputs a cover letter. I don’t like writing BS cover letters where I pretend I majored in the company mission and my whole life has been teaching me their values. GPT can do that for me though- and yes I fact check but I’m fact checking against my resume and personal opinions which I obviously know quite well.

notahacker 4y ago
But the whole point of these debates is a discussion about whether Bing is going to eat Google's lunch in search, which very much is about finding out about things like companies' exec teams. The ability of an LLM to generate decent content (provided you're an attentive editor or the users of the content aren't too discerning) could be huge for Office365, but that's irrelevant to any potential threat to Google, since Docs is of very little importance to Google's revenues and strategy in a market where Office is completely dominant and has always had a more full-featured product.
- charlieflowers 4y ago
  > But the whole point ... is ... in _search_ (not content generation) True. And also, keep in mind ... it doesn't truly have to be _better_ than Google search. You just need to start and maintain a _social trend_ so that the mainstream public _chooses_ it over Google. People use Google because it's the first and only option that comes to mind -- they haven't actually compared its accuracy to anything else in a long time (the audience of Hacker News is of course an exception).
- vineyardmike 4y ago
  > whether Bing is going to eat Google's lunch in search, There are a few types of search queries that people seem to do, factual lookups ("who is the exec of abc?"), but also generally treat the search engine as the entryway to the internet ("I need a teaching plan about Ukraine"). We'll see that LLM fall flat for facts (assuming people care), but they can supplant some of the general traffic. Realistically, its a bad fact search replacement, but it could be a great tool to put next to a search bar, making a better "starting place for accessing the internet". With the teaching plan example, the original user was probably going to make a query for a template (or 5), then copy+paste, then do 10-100 queries learning all about Ukraine history and culture, then rewrite that into the template, editing down to manageable size, then send to peers to edit and review, then format for distribution. That could be dozens of Google searches. Now, one or two AI queries, and they have a template, basic written text, and can focus on a couple queries for fact checking. Oh, and since they used bing to do the AI part, they may just stick with bing for the fact check part. Google was irrelevant in that whole flow instead of getting dozens of queries over a day before, but if that feature was moved to Office365, then they may never have used bing for search while still killing a chunk of google's traffic. The danger to google is not equal to the opportunity to bing. If 5-10% of traffic never reaches a google search, that's a huge chunk of google's revenue, even if it doesn't translate to searches on a different engine. Think of the potential impact an AI code generator could have on StackOverflow. When I need to pick up a new language, I often query "how to append to an array in python" in a search engine, but a LLM (or large-code-model) built into my IDE could supplant that query entirely. I
  - notahacker 4y ago
    An analogue of Jevons' law applies here. I doubt you hand wrote cover letters by making dozens of search queries (similarly, I doubt people devise teaching curricula by learning the history of Ukraine through a series of Google queries). But when you weren't taking the time to write them yourself, I bet you had more time free to search for jobs, or do general internet browsing using Google as your gateway to the internet... People having more time free to browse the internet is unlikely to be a threat to Google's business, even in the highly unlikely scenario Google is incapable of advancing its existing AI products beyond their current state

notahacker 4y ago

But the whole point of these debates is a discussion about whether Bing is going to eat Google's lunch in search, which very much is about finding out about things like companies' exec teams. The ability of an LLM to generate decent content (provided you're an attentive editor or the users of the content aren't too discerning) could be huge for Office365, but that's irrelevant to any potential threat to Google, since Docs is of very little importance to Google's revenues and strategy in a market where Office is completely dominant and has always had a more full-featured product.

charlieflowers 4y ago
> But the whole point ... is ... in _search_ (not content generation) True. And also, keep in mind ... it doesn't truly have to be _better_ than Google search. You just need to start and maintain a _social trend_ so that the mainstream public _chooses_ it over Google. People use Google because it's the first and only option that comes to mind -- they haven't actually compared its accuracy to anything else in a long time (the audience of Hacker News is of course an exception).
vineyardmike 4y ago
> whether Bing is going to eat Google's lunch in search, There are a few types of search queries that people seem to do, factual lookups ("who is the exec of abc?"), but also generally treat the search engine as the entryway to the internet ("I need a teaching plan about Ukraine"). We'll see that LLM fall flat for facts (assuming people care), but they can supplant some of the general traffic. Realistically, its a bad fact search replacement, but it could be a great tool to put next to a search bar, making a better "starting place for accessing the internet". With the teaching plan example, the original user was probably going to make a query for a template (or 5), then copy+paste, then do 10-100 queries learning all about Ukraine history and culture, then rewrite that into the template, editing down to manageable size, then send to peers to edit and review, then format for distribution. That could be dozens of Google searches. Now, one or two AI queries, and they have a template, basic written text, and can focus on a couple queries for fact checking. Oh, and since they used bing to do the AI part, they may just stick with bing for the fact check part. Google was irrelevant in that whole flow instead of getting dozens of queries over a day before, but if that feature was moved to Office365, then they may never have used bing for search while still killing a chunk of google's traffic. The danger to google is not equal to the opportunity to bing. If 5-10% of traffic never reaches a google search, that's a huge chunk of google's revenue, even if it doesn't translate to searches on a different engine. Think of the potential impact an AI code generator could have on StackOverflow. When I need to pick up a new language, I often query "how to append to an array in python" in a search engine, but a LLM (or large-code-model) built into my IDE could supplant that query entirely. I
- notahacker 4y ago
  An analogue of Jevons' law applies here. I doubt you hand wrote cover letters by making dozens of search queries (similarly, I doubt people devise teaching curricula by learning the history of Ukraine through a series of Google queries). But when you weren't taking the time to write them yourself, I bet you had more time free to search for jobs, or do general internet browsing using Google as your gateway to the internet... People having more time free to browse the internet is unlikely to be a threat to Google's business, even in the highly unlikely scenario Google is incapable of advancing its existing AI products beyond their current state