3 ms·

I'm not sure a data center run by ... Palantir of all organizations is what people have in mind when they worry about data sovereignty.

by vrganj 2mo ago

adrian_b 2mo ago
They are selling it, not running it. It is just a dedicated computer system, which should be managed by its owner, like any other on-prem servers. I doubt that it has a good price/performance ratio, but it is a solution for those who feel that they do not want to search, buy, assemble, install and configure every HW/SW component.
- Panoramix 2mo ago
  For those that don't mind a lot of rootkit and embedded spyware you mean
- iinnPP 2mo ago
  I take it we saw different demos. I'm under no NDA, if you actually want to know what's up.
  - XVII 2mo ago
    I want to know, please tell us
    - deleted 2mo ago
      [deleted]
  - idiotsecant 2mo ago
    Ohhh spooky vaguepost.
  - oarsinsync 2mo ago
    I'm assuming you're alluding to them selling a managed solution, alongside the unmanaged solution that the GP is referring to?
crossroadsguy 2mo ago
Fair but the idea of "running your LLM setup" at every "need" level and corresponding cost does make sense. For a lot of people (and orgs I'd guess) who just go and buy ≈$20 per month plans (or more for teams), they might not even need a fraction of that cost or capability. A lot of them don't even need it for coding or graphics. Even the API access based pricing aren't great from these frontier US AI houses. The distribution of "LLM being" offered will also give rise to many open-router like offering but at the end point level - direct interfaces to the customers. Pick your vendor sort. AI shouldn't become another "search means Google".
blensor 2mo ago
I mean you could opt for the exabox from tinygrad https://tinygrad.org/#tinybox https://tinygrad.org/#tinybox It comes in a full sized shipping container and costs around $10M but money has stopped being connected to reality now anyway with all the AI company valuations being floated around, so who cares about a few million here or there.

I'm not sure a data center run by ... Palantir of all organizations is what people have in mind when they worry about data sovereignty.

by vrganj 2mo ago

I'm not sure a data center run by ... Palantir of all organizations is what people have in mind when they worry about data sovereignty.

adrian_b 2mo ago

They are selling it, not running it. It is just a dedicated computer system, which should be managed by its owner, like any other on-prem servers. I doubt that it has a good price/performance ratio, but it is a solution for those who feel that they do not want to search, buy, assemble, install and configure every HW/SW component.

Panoramix 2mo ago
For those that don't mind a lot of rootkit and embedded spyware you mean
iinnPP 2mo ago
I take it we saw different demos. I'm under no NDA, if you actually want to know what's up.
- XVII 2mo ago
  I want to know, please tell us
  - deleted 2mo ago
    [deleted]
- idiotsecant 2mo ago
  Ohhh spooky vaguepost.
- oarsinsync 2mo ago
  I'm assuming you're alluding to them selling a managed solution, alongside the unmanaged solution that the GP is referring to?

crossroadsguy 2mo ago

Fair but the idea of "running your LLM setup" at every "need" level and corresponding cost does make sense. For a lot of people (and orgs I'd guess) who just go and buy ≈$20 per month plans (or more for teams), they might not even need a fraction of that cost or capability. A lot of them don't even need it for coding or graphics. Even the API access based pricing aren't great from these frontier US AI houses. The distribution of "LLM being" offered will also give rise to many open-router like offering but at the end point level - direct interfaces to the customers. Pick your vendor sort. AI shouldn't become another "search means Google".

blensor 2mo ago

I mean you could opt for the exabox from tinygrad https://tinygrad.org/#tinybox https://tinygrad.org/#tinybox It comes in a full sized shipping container and costs around $10M but money has stopped being connected to reality now anyway with all the AI company valuations being floated around, so who cares about a few million here or there.