4 ms·

> The GPU version is commercial software. Please contact... Shame.

by summarity 4y ago

copperx 4y ago
Shame as in "it's a shame" or as in "shame on them"?
- minxomat 4y ago
  The former. Makes sense for their business model.
dark-star 4y ago
I'm pretty sure a dev skilled in ML and GPUs has no trouble modifying the MIT code (which runs on the CPU) to something that runs on GPUs...
- EMIRELADERO 4y ago
  The CPU version is provided under binary format only.
  - thetoon 4y ago
    You're right : `The CPU version is released as binary code under the MIT license`. That's quite an unusual choice, not even sure how MIT would apply to that...
    - Aissen 4y ago
      The goal here is to allow you to redistribute while maintaining the copyright notice.
    - capableweb 4y ago
      You can release whatever you want under MIT :) It grants you the right to use the binary for commercial projects (or any type of projects you want), to modify the binary, distribute it yourself and more. You cannot hold Bellard/the license holder liable for anything related to it, and you must include the license and copyright if you distribute it. Seems pretty doable to me :)
    - circuit10 4y ago
      I guess you could decompile it and redistribute that source if you were dedicated enough
etaioinshrdlu 4y ago
I think it's fine if a software legend (or anyone) wants to make some income.
versteegen 4y ago
The GPU version of libNC is available as a free binary, and you can find MIT-licensed source code implementing (training and inference of) transformers using libNC at https://bellard.org/nncp https://bellard.org/nncp. (nncp was meant to be a submission to the Hutter Prize, which would have required open-sourcing libNC too, but it didn't qualify due to using AVX2 and too much RAM. At least the CPU version binary is MIT licensed since ts_server is.) I think it wouldn't be that big a project to support LLaMa starting from that code, although it is dense code. Edit: licensing
- sroecker 4y ago
  That version of libnc_cuda.so doesn't seem to be compatible with ts_server though.
rvz 4y ago
"Shame. I cannot take the code / binary and run it as a SaaS efficiently." - HNers Good for him to commercialize it, and at least he is not pretending to be a non-profit accepting VC money.
- alexvoda 4y ago
  Countering SaaS-ifying by others can also be achieved through the AGPL or through the BSL (initially not open-source, reverts to open source after set period). I do believe one of the failures of GPL was not being AGPL from the start.

> The GPU version is commercial software. Please contact... Shame.

copperx 4y ago

Shame as in "it's a shame" or as in "shame on them"?

minxomat 4y ago
The former. Makes sense for their business model.

dark-star 4y ago

I'm pretty sure a dev skilled in ML and GPUs has no trouble modifying the MIT code (which runs on the CPU) to something that runs on GPUs...

EMIRELADERO 4y ago
The CPU version is provided under binary format only.
- thetoon 4y ago
  You're right : `The CPU version is released as binary code under the MIT license`. That's quite an unusual choice, not even sure how MIT would apply to that...
  - Aissen 4y ago
    The goal here is to allow you to redistribute while maintaining the copyright notice.
  - capableweb 4y ago
    You can release whatever you want under MIT :) It grants you the right to use the binary for commercial projects (or any type of projects you want), to modify the binary, distribute it yourself and more. You cannot hold Bellard/the license holder liable for anything related to it, and you must include the license and copyright if you distribute it. Seems pretty doable to me :)
  - circuit10 4y ago
    I guess you could decompile it and redistribute that source if you were dedicated enough

etaioinshrdlu 4y ago

I think it's fine if a software legend (or anyone) wants to make some income.

versteegen 4y ago

The GPU version of libNC is available as a free binary, and you can find MIT-licensed source code implementing (training and inference of) transformers using libNC at https://bellard.org/nncp https://bellard.org/nncp. (nncp was meant to be a submission to the Hutter Prize, which would have required open-sourcing libNC too, but it didn't qualify due to using AVX2 and too much RAM. At least the CPU version binary is MIT licensed since ts_server is.) I think it wouldn't be that big a project to support LLaMa starting from that code, although it is dense code. Edit: licensing

sroecker 4y ago
That version of libnc_cuda.so doesn't seem to be compatible with ts_server though.

rvz 4y ago

"Shame. I cannot take the code / binary and run it as a SaaS efficiently." - HNers Good for him to commercialize it, and at least he is not pretending to be a non-profit accepting VC money.

alexvoda 4y ago
Countering SaaS-ifying by others can also be achieved through the AGPL or through the BSL (initially not open-source, reverts to open source after set period). I do believe one of the failures of GPL was not being AGPL from the start.