3 ms·

Everyone using AI in production is using Pytorch by Meta. Which is open source. I do not know anybody important in the AI space apart from Google using Tensor

Everyone using AI in production is using Pytorch by Meta. Which is open source. I do not know anybody important in the AI space apart from Google using TensorFlow.

Philpax 3y ago
That may be true, but it's largely irrelevant. The ML framework in use has no bearing on whether or not you have the data required to reproduce the model being trained with that framework.
- colesantiago 3y ago
  Do you and the GP have 350K GPUs and quality data to reproduce 1:1 whatever Facebook releases in their repos? Even if you want to reproduce the model and they give you the data, you would need to do this at Facebook scale, so you and the GP are just making moot points all around. https://about.fb.com/news/2023/05/metas-infrastructure-for-ai/ https://about.fb.com/news/2023/05/metas-infrastructure-for-a... https://www.theregister.com/2024/01/20/metas_ai_plans/ https://www.theregister.com/2024/01/20/metas_ai_plans/ The fact that these models are coming from Meta in the open rather than Google which releases only papers with no model tell's me that Meta's models is open enough for everyone to use. Besides, everyone using the Pytorch framework benefits Meta in the same way they were originally founded as a company: Network effects It's relevant.
  - Philpax 3y ago
    There are organisations that are capable of reproduction (e.g. EleutherAI), but yes, you're right, not having the data is largely irrelevant for most users. The thing that bothers me more is that it's not actually an open-source licence; there are restrictions on what you can do with it, and whatever you do with the model is subject to those restrictions. It's still very useful and I'm not opposed to them releasing it under that licence (they need to recoup the costs somehow), but "open-source" (or even "open") it is not.
  - xigoi 3y ago
    If you don’t have a machine powerful enough to compile some heavy AAA game, does that make the game open source?

Everyone using AI in production is using Pytorch by Meta. Which is open source. I do not know anybody important in the AI space apart from Google using TensorFlow.

Philpax 3y ago

That may be true, but it's largely irrelevant. The ML framework in use has no bearing on whether or not you have the data required to reproduce the model being trained with that framework.

colesantiago 3y ago
Do you and the GP have 350K GPUs and quality data to reproduce 1:1 whatever Facebook releases in their repos? Even if you want to reproduce the model and they give you the data, you would need to do this at Facebook scale, so you and the GP are just making moot points all around. https://about.fb.com/news/2023/05/metas-infrastructure-for-ai/ https://about.fb.com/news/2023/05/metas-infrastructure-for-a... https://www.theregister.com/2024/01/20/metas_ai_plans/ https://www.theregister.com/2024/01/20/metas_ai_plans/ The fact that these models are coming from Meta in the open rather than Google which releases only papers with no model tell's me that Meta's models is open enough for everyone to use. Besides, everyone using the Pytorch framework benefits Meta in the same way they were originally founded as a company: Network effects It's relevant.
- Philpax 3y ago
  There are organisations that are capable of reproduction (e.g. EleutherAI), but yes, you're right, not having the data is largely irrelevant for most users. The thing that bothers me more is that it's not actually an open-source licence; there are restrictions on what you can do with it, and whatever you do with the model is subject to those restrictions. It's still very useful and I'm not opposed to them releasing it under that licence (they need to recoup the costs somehow), but "open-source" (or even "open") it is not.
- xigoi 3y ago
  If you don’t have a machine powerful enough to compile some heavy AAA game, does that make the game open source?