4 ms·

These large models are going to be the operating system of the future. When they are going to run efficiently on edge we are going to see an explosion of automa

These large models are going to be the operating system of the future. When they are going to run efficiently on edge we are going to see an explosion of automation. Being so large they are not only more accurate, but also quicker learners. So less initial effort to start a project. Google is teasing us with leaks about Pathways[1], but not releasing a paper or demo yet. [1] https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/ https://blog.google/technology/ai/introducing-pathways-next-... I call them multi-multi-models: multi-modality, multi-task, multi-language, multi-memory (besides the processing memory it can have search engine in the loop and episodic memory). Somebody's going to make it in the next couple of years.

Moru 5y ago
The sad part is that we are all helping to train the futures AI but who will own it and make money on it?
- wetpaws 5y ago
  You can have ownership in companies that do machine learning. It's called "shares". Creating your own business is an option too.
  - frenchyatwork 5y ago
    The complaint was that it's the people who own the equipment (or shares in it), and not the people who do the work, who are reaping the profit. When the working class had this problem a couple centuries ago, it was solved by building guillotines. I hope we can do better this time.
    - thehappypm 5y ago
      You’re conflating two things. Feudalism is like slavery: taking credit for someone else’s labor. Automation removes the need for labor. Automation has almost universally led to quality of life improvements, not revolution.
    - rowanG077 5y ago
      To start an AI company you generally don't need much. A few thousands in GPUs and you are good to go. If AI researchers feel they are underpaid there is literally nothing stopping them from starting a company themselves.
      - gmadsen 5y ago
        that is absolutely not true. I'm not sure where you are getting your information, but read anything from an angel investor. most AI start ups fail because they go into huge debt getting correct data and training models, which end up bankrupting them in the process with nothing to show for it
        rowanG077 5y ago
        If you need to collect date then you are not only an AI company. And in that case a large company is indeed needed.
    - fartattack 5y ago
      Sorry, are you claiming that the French Revolution occurred due to bad labor practices? Or did trust busting and unionization in the late 19th century US utilize guillotines? Either of those would certainly be a.. uh.. let's go with "novel" retelling of the history! Or did you mean Red October? Because I'm pretty sure /that/ revolution didn't actually solve any problems for the worker in the way things actually panned out
    - wetpaws 5y ago
      I don't see any problem with it, stock market is open for everyone.
      - giovannibonetti 5y ago
        Nowadays startups often delay going to the stock market, and remain private while they're growing fast. It's only when they are growing more slowly and the VCs want to get out that they go public. This way, the average investor usually does not reap outsized benefits from the ride.
- visarga 5y ago
  > who will own it and make money on it? The nice part about it is that everyone will have access to great models for direct use, fine-tuning and adaptation. But if people don't take this freedom and are content with simply consuming applications, then they depend on those who deploy the apps.
andreyk 5y ago
IMHO (as a AI researcher) 'multi-modality, multi-task, multi-language, multi-memory' may take longer than you think. Doing multi modal learning is quite hard due to lack of labeled data, a lot of tasks either don't offer clean plentiful datasets or require RL / human in the loop learning and not just supervised or self supervised learning, and on and on. Certainly a lot of progress will be made and partial automation is likely to speed up (as has happened with Copilot), but full automation seems to be a good while away. Plug - I expand on this a bit in this blog post 'The Inherent Limitations of GPT-3' (which was on front page of HN a few weeks back and led to a good deal of discussion ) https://lastweekin.ai/p/the-inherent-limitations-of-gpt-3 https://lastweekin.ai/p/the-inherent-limitations-of-gpt-3

Moru 5y ago

The sad part is that we are all helping to train the futures AI but who will own it and make money on it?

wetpaws 5y ago
You can have ownership in companies that do machine learning. It's called "shares". Creating your own business is an option too.
- frenchyatwork 5y ago
  The complaint was that it's the people who own the equipment (or shares in it), and not the people who do the work, who are reaping the profit. When the working class had this problem a couple centuries ago, it was solved by building guillotines. I hope we can do better this time.
  - thehappypm 5y ago
    You’re conflating two things. Feudalism is like slavery: taking credit for someone else’s labor. Automation removes the need for labor. Automation has almost universally led to quality of life improvements, not revolution.
  - rowanG077 5y ago
    To start an AI company you generally don't need much. A few thousands in GPUs and you are good to go. If AI researchers feel they are underpaid there is literally nothing stopping them from starting a company themselves.
    - gmadsen 5y ago
      that is absolutely not true. I'm not sure where you are getting your information, but read anything from an angel investor. most AI start ups fail because they go into huge debt getting correct data and training models, which end up bankrupting them in the process with nothing to show for it
      - rowanG077 5y ago
        If you need to collect date then you are not only an AI company. And in that case a large company is indeed needed.
  - fartattack 5y ago
    Sorry, are you claiming that the French Revolution occurred due to bad labor practices? Or did trust busting and unionization in the late 19th century US utilize guillotines? Either of those would certainly be a.. uh.. let's go with "novel" retelling of the history! Or did you mean Red October? Because I'm pretty sure /that/ revolution didn't actually solve any problems for the worker in the way things actually panned out
  - wetpaws 5y ago
    I don't see any problem with it, stock market is open for everyone.
    - giovannibonetti 5y ago
      Nowadays startups often delay going to the stock market, and remain private while they're growing fast. It's only when they are growing more slowly and the VCs want to get out that they go public. This way, the average investor usually does not reap outsized benefits from the ride.
visarga 5y ago
> who will own it and make money on it? The nice part about it is that everyone will have access to great models for direct use, fine-tuning and adaptation. But if people don't take this freedom and are content with simply consuming applications, then they depend on those who deploy the apps.

andreyk 5y ago

IMHO (as a AI researcher) 'multi-modality, multi-task, multi-language, multi-memory' may take longer than you think. Doing multi modal learning is quite hard due to lack of labeled data, a lot of tasks either don't offer clean plentiful datasets or require RL / human in the loop learning and not just supervised or self supervised learning, and on and on. Certainly a lot of progress will be made and partial automation is likely to speed up (as has happened with Copilot), but full automation seems to be a good while away. Plug - I expand on this a bit in this blog post 'The Inherent Limitations of GPT-3' (which was on front page of HN a few weeks back and led to a good deal of discussion ) https://lastweekin.ai/p/the-inherent-limitations-of-gpt-3 https://lastweekin.ai/p/the-inherent-limitations-of-gpt-3