5 ms·
Google cancels contract with an AI data firm that's helped train Bard
- ijhuygft776 3y agoisnt gemini the new thing? but for me, Bard works better than the new ChatGPT (not the old one though)
- LightBug1 3y agoSurprisingly, the same for me. This feel likes a 'good enough' vs 'premium' battle at the moment. You'll probably get better results with pay-for-play chatGPT ... but if Bard/Gemini is 'good enough', why bother? Jury's still out.
- ijhuygft776 3y ago[flagged]
- danpalmer 3y agoBard is a user-facing product, Gemini is an internal/developer facing model. Bard is now backed by Gemini and its various forms, but used to be backed by PaLM/2. Similarly, ChatGPT is a user-facing product, and GPT3, 3.5, 4, etc, are the developer facing models. OpenAI expose a bit more of the GPT branding to users allowing them to directly select the model in ChatGPT, but Google hasn't done this, I would guess for product reasons. The main distinction is that Bard/ChatGPT are fine-tuned to be conversational, whereas the raw models are not necessarily. For example, in Google Workspace you can have an LLM draft an email for you, but this is not Bard, it's not conversational, it doesn't chat back and forth, it takes a prompt and generates an email, which is what it was fine-tuned to do. Bard/ChatGPT can write emails, but they aren't explicitly trained to do so and will discuss the email with you more.
- huytersd 3y agoHopefully Gemini is Bette because I have much better results with ChatGPT.
- benreesman 3y agoThe Nanny model stuff has basically eliminated gpt-4-1106-preview from my stable of go-to models, which is a shame because it’s pretty good (not the undisputed best, that’s marketing). Today I wanted to drop some generated files into a Bazel workspace (just like Gazelle and stuff do all the time) and it was just like “builds are hermitic for a reason…” and after like my 3rd time trying to force it I was like “I’m arguing with a toaster, it’s come to this.” M-x dolphin-region-task “Write an Eminem style diss track about how much this sucks and then tell me the magic spell for the Starlark thing”. Yeah, that was better.
- ladzoppelin 3y agoEvery time I try Bard and the "new" Gemini it hallucinates so bad I get scared to try it again. Its circumstantial and I only use it for tech stuff and each time its immediately returned a very believable parameter that makes me laugh to myself at how stupid I was for not knowing it. I only use GPT4 so maybe 3.5 does the same thing.
- ta988 3y agoIn my experience, Llama2, mixtral, bard/gemini hallucinate so much more than gpt3.5 that they are unusable. For trivial things and small examples you could be fooled. But large scale when you need somewhat accurate results, they aren't great
- tussa 3y ago> often handle many of the more distasteful parts of training AI Does anyone have an example on what these people could have been doing for an $10/h?
- FirmwareBurner 3y agoFiltering dicks from hotdogs so Bard can identify not-hotdogs?
- wpasc 3y agoand hotdogs
- ToucanLoucan 3y agoIf discussions elsewhere are any indication, apparently filtering out some of, but not limited to the following: - Graphic violence - Child abuse material - Non-consentual pornography - Fetish/misc. offensive material And I'm guessing those employees don't get mental healthcare benefits.
- dathinab 3y agoFor example stuff like manual classification/feedback manual "testing" various release candidates (more for which feels better then which is better, benchmarks are likely automatized) or stuff like "filter out all offensive text/pictures", which could include some pretty bad stuff rate this X answers are this filtered answers which where filtered out as inappropriate actually inappropriate? etc. etc.
- bhickey 3y agohttps://blog.google/products/search/overview-our-rater-guidelines-search/ https://blog.google/products/search/overview-our-rater-guide... > Our search quality raters provide us with insights and evaluate pages against our guidelines to help make sure our systems — and proposed improvements — are working as intended. > What that looks like in practice is often a “side-by-side” test where a rater will look at two sets of Search results, one from the current version of Google and the other from an improvement we’re testing. Raters will review the pages in each set of results, and evaluate if the pages are a helpful match for the query based on our rater guidelines. https://static.googleusercontent.com/media/guidelines.raterhub.com/en//searchqualityevaluatorguidelines.pdf https://static.googleusercontent.com/media/guidelines.raterh...
- mvdtnz 3y agoThis is unremarkable. Companies use contract labour for the express reason that they can dip in and dip out. Sounds like Appen were on a gravy train and didn't work hard enough to diversify their portfolio of clients.
- sagman 3y agoReminds me of that episode of Mad Men where Lucky Strike drops SCDP as their advertising agency. Hope they have their Don Draper
- Yellow98Pikachu 3y agoI agree, it looks like they will be back at the numbers from 2019. Which is of course a stepback, but I imagine they will learn something from it. Overall they are still growing, for example, in 2015 they had "only" $43.83 Mil in revenue.
- byyoung3 3y agoLabelers
- kazinator 3y agoBreaking news! Area man cancels contract with plumber, after leaky toilet fixed.
- spraveenitpro 3y ago[dead]
- bb88 3y ago[flagged]
- tomjakubowski 3y agoyou're asking why jeff dean isn't being employed full-time in data labeling?
- ethbr1 3y ago> Fast Company wrote last year that some Appen employees who are members of the Alphabet Workers Union had been petitioning Appen to increase wages from $10 an hour to $15. While the union won wage increases, the final number fell short of its goal. Many of these workers were then laid off, with Appen citing business conditions. "business conditions"
- gwern 3y agoGoogle canceling their contract certainly isn't going to help their business conditions, you have to admit.
- 1vuio0pswjnm7 3y ago"Human workers at companies like Appen often handle many of the more distasteful parts of training AI and are often the lower-paid, often ignored backbone of the entire industry. At Appen, contractors help rate data quality and answers from AI models. Fast Company wrote last year that some Appen employees who are members of the Alphabet Workers Union had been petitioning Appen to increase wages from $10 an hour to $15."
- bfeist 3y agoLive by the sword; die by the sword.
- itsdrewmiller 3y agoNotably not Accenture, which is where the conflict over whether Google is coemployer for unionization purposes is happening. Previous HN discussion here - https://news.ycombinator.com/item?id=38873878 https://news.ycombinator.com/item?id=38873878