6 ms·

Could someone please compete with GPT-3? This is getting ridiculous how far ahead OpenAi is getting, despite Google probably having better tech. It seems nobo

Could someone please compete with GPT-3? This is getting ridiculous how far ahead OpenAi is getting, despite Google probably having better tech. It seems nobody else has the big brass balls of the OpenAI guys to put a large language model out there and deal with the consequences. Yann LeCun is on Twitter saying this isn't a big deal[1], but where's Facebook's LLM that's available to the public? [1]https://twitter.com/ylecun/status/1620533783702433792 https://twitter.com/ylecun/status/1620533783702433792

_4bjt 4y ago
> where's Facebook's LLM that's available to the public? https://blenderbot.ai/ https://blenderbot.ai/
- thethimble 4y ago
  The response quality of BlenderBot is pretty bad compared to ChatGPT Example question: What’s a covariance matrix? BlenderBot: Principal component analysis is a popular technique for analyzing large datasets containing a high number of dimensions/features per observation, increasing the interpretability of data while preserving the maximum amount of information, and enabling the visualization of multidimensional data. ChatGPT: A covariance matrix is a symmetric matrix that describes the covariance between multiple variables in a given dataset. The diagonal elements of the matrix represent the variance of each variable, and the off-diagonal elements represent the covariance between each pair of variables. The covariance matrix is used in multivariate statistics to understand the relationships between different variables and to perform statistical inference and hypothesis testing.
- narrator 4y ago
  I tried it. It can't answer basic encyclopedia facts (e.g How many people died in World War II). It can't do basic programming (e.g write a javascript function to reverse a string). Just goes to show that everyone besides OpenAI are so terrified of these things that they can only release versions that are toys. Do these companies fear their customers that much? Maybe that's the difference between Microsoft/OpenAI and Facebook/Google. Microsoft sells the LLM to the customer who will be more impressed by the product if it's useful. With Facebook/Google the product uses the LLM. The LLM may make them an unsuitable product if they don't click on an ad after using it.
- deleted 4y ago
  [deleted]
jakear 4y ago
> despite Google probably having better tech What makes you so sure? Microsoft already has a fully productized LLM that people pay for and has in turn provided real value to both users and the company (copilot). To assert that some other company has a better one but it's... not ready yet? is odd. I can't think of the last time Google made a new product. New as in "not a reimplementation of what another company already productized", product as in "people pay for it". I don't think they have what it takes. Edit: my bet is Google makes a free to play version that is ad supported, as they're want to do. The question is where do the ads go. The answer, most likely, is in the responses. So instead of reading the most likely continuation of a string, you get what the highest bidder wants the most likely continuation to be. Hooray.
- Jensson 4y ago
  You can buy flight tickets from Google, that is a relatively new product even if you buy them from the search result. So Google search is good at adding new products that are context sensitive to your query, I don't see why they couldn't make such things with a chat bot answering question queries instead of just trying to link to sites with answers.
  - jakear 4y ago
    > a chat bot answering question queries instead of just trying to link to sites with answers And kill their golden goose? Google makes more money the longer you spend on their ad-ridden search result pages. I don't doubt they'll make a question answering bot, but the real question is how they fund it (see edit above for my guess).
    - Jensson 4y ago
      > Google makes more money the longer you spend on their ad-ridden search result pages. So why not keep people there by having an engaging chat bot? Could even refresh and add new context sensitive ads every time you ask something new.
    - kerpotgh 4y ago
swatcoder 4y ago
There's no rush. This space is so immature and yet so plainly ripe that there's little benefit to being first. Leapfrogging with matured market insight is where the big winners live. OpenAI will have a secure home with Microsoft, but aren't positioned to run away with anything anytime soon. They're at least as likely to be the Altavista to Google Search, the Napster to Spotify, the MySpace to Facebook, etc
nmfisher 4y ago
It's easy to look like you're "ahead" by constantly releasing shiny new things that aren't actually profitable. Until OpenAI is generating billions in profit, I wouldn't be so quick to criticize the other big companies. Google in particular has a reputation[0] to defend - they're not going to risk their cash cow with a half-cocked LLM that spouts patent falsehoods half the time. Not to mention the false economics of losing money on every single search. [0] - the reputation might be sullied amongst the HN crowd, but they're negligible when it comes to dominance of Google as a search engine for normies.
spyder 4y ago
"but where's Facebook's LLM that's available to the public" They are trying it, here: https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/ https://ai.facebook.com/blog/democratizing-access-to-large-s... Demo: https://opt.alpa.ai/ https://opt.alpa.ai/ But it's clearly not as good as GPT3.5

_4bjt 4y ago

> where's Facebook's LLM that's available to the public? https://blenderbot.ai/ https://blenderbot.ai/

thethimble 4y ago
The response quality of BlenderBot is pretty bad compared to ChatGPT Example question: What’s a covariance matrix? BlenderBot: Principal component analysis is a popular technique for analyzing large datasets containing a high number of dimensions/features per observation, increasing the interpretability of data while preserving the maximum amount of information, and enabling the visualization of multidimensional data. ChatGPT: A covariance matrix is a symmetric matrix that describes the covariance between multiple variables in a given dataset. The diagonal elements of the matrix represent the variance of each variable, and the off-diagonal elements represent the covariance between each pair of variables. The covariance matrix is used in multivariate statistics to understand the relationships between different variables and to perform statistical inference and hypothesis testing.
narrator 4y ago
I tried it. It can't answer basic encyclopedia facts (e.g How many people died in World War II). It can't do basic programming (e.g write a javascript function to reverse a string). Just goes to show that everyone besides OpenAI are so terrified of these things that they can only release versions that are toys. Do these companies fear their customers that much? Maybe that's the difference between Microsoft/OpenAI and Facebook/Google. Microsoft sells the LLM to the customer who will be more impressed by the product if it's useful. With Facebook/Google the product uses the LLM. The LLM may make them an unsuitable product if they don't click on an ad after using it.
deleted 4y ago
[deleted]

jakear 4y ago

> despite Google probably having better tech What makes you so sure? Microsoft already has a fully productized LLM that people pay for and has in turn provided real value to both users and the company (copilot). To assert that some other company has a better one but it's... not ready yet? is odd. I can't think of the last time Google made a new product. New as in "not a reimplementation of what another company already productized", product as in "people pay for it". I don't think they have what it takes. Edit: my bet is Google makes a free to play version that is ad supported, as they're want to do. The question is where do the ads go. The answer, most likely, is in the responses. So instead of reading the most likely continuation of a string, you get what the highest bidder wants the most likely continuation to be. Hooray.

Jensson 4y ago
You can buy flight tickets from Google, that is a relatively new product even if you buy them from the search result. So Google search is good at adding new products that are context sensitive to your query, I don't see why they couldn't make such things with a chat bot answering question queries instead of just trying to link to sites with answers.
- jakear 4y ago
  > a chat bot answering question queries instead of just trying to link to sites with answers And kill their golden goose? Google makes more money the longer you spend on their ad-ridden search result pages. I don't doubt they'll make a question answering bot, but the real question is how they fund it (see edit above for my guess).
  - Jensson 4y ago
    > Google makes more money the longer you spend on their ad-ridden search result pages. So why not keep people there by having an engaging chat bot? Could even refresh and add new context sensitive ads every time you ask something new.
  - kerpotgh 4y ago

swatcoder 4y ago

There's no rush. This space is so immature and yet so plainly ripe that there's little benefit to being first. Leapfrogging with matured market insight is where the big winners live. OpenAI will have a secure home with Microsoft, but aren't positioned to run away with anything anytime soon. They're at least as likely to be the Altavista to Google Search, the Napster to Spotify, the MySpace to Facebook, etc

nmfisher 4y ago

It's easy to look like you're "ahead" by constantly releasing shiny new things that aren't actually profitable. Until OpenAI is generating billions in profit, I wouldn't be so quick to criticize the other big companies. Google in particular has a reputation[0] to defend - they're not going to risk their cash cow with a half-cocked LLM that spouts patent falsehoods half the time. Not to mention the false economics of losing money on every single search. [0] - the reputation might be sullied amongst the HN crowd, but they're negligible when it comes to dominance of Google as a search engine for normies.

spyder 4y ago

"but where's Facebook's LLM that's available to the public" They are trying it, here: https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/ https://ai.facebook.com/blog/democratizing-access-to-large-s... Demo: https://opt.alpa.ai/ https://opt.alpa.ai/ But it's clearly not as good as GPT3.5