4 ms·

A few thoughts: * A Singapore based company, according to LinkedIn. There doesn't seem to be much of a barrier to entry to building a very good LLM. * Open we

A few thoughts: * A Singapore based company, according to LinkedIn. There doesn't seem to be much of a barrier to entry to building a very good LLM. * Open weight models + the development of Strix Halo / Ryzen AI Max makes me optimistic that running great LLMs locally will be relatively cheap in a few years.

rfoo 1y ago
> A Singapore based company, according to LinkedIn Nah, this is a Shanghai-based company.
- diggan 1y ago
  [flagged]
  - noelwelsh 1y ago
    https://en.wikipedia.org/wiki/MiniMax_(company) https://en.wikipedia.org/wiki/MiniMax_(company)
    - diggan 1y ago
      Wikipedia in itself is no source, and after reading parents message I went there to check to and surprise surprise, neither of the statements have sources attached to it. None of the linked articles have any information about where their headquarters is either. If someone knows of a trustworthy article that states it outright, please feel free to share.
      - noelwelsh 1y ago
        I'm the OP who claimed it was Singaporean, after checking LinkedIn. I then found the Wikipedia page, which I posted above. Amongst the comments here there is also a link to a Bloomberg article about a potential IPO. I don't have a dog in the race. Just passing on what I found.
        nimchimpsky 1y ago
        [dead]
  - Deathmax 1y ago
    https://www.minimaxi.com https://www.minimaxi.com is their website for the Chinese parent company 上海稀宇科技有限公司, https://minimax.io https://minimax.io is their international website for the Singapore based company Nanonoble Pte Ltd that handles operations outside of China.
  - rfoo 1y ago
    What source do you want? I have a few friends who work for them and they all live in either Shanghai (most) or Beijing. And I've never seen anyone who claimed they are based in Singapore or anywhere else before. Does this work?
manc_lad 1y ago
It seems more and more like an inevitability we will run models locally. Exciting and concerning implications. If anyone has any suggestions of people thinking about this space they respect, I'd love to listen to more ideas and thoughts on the developments.
- noelwelsh 1y ago
  I think the main limitation, right now, is hardware. For GPUs the main limit is the VRAM available on consumer models. CPUs have plenty of memory but don't have the bandwidth or vector compute power for LLMs. This is why I think the Strix Halo is so exciting: it has bandwidth + compute power plus a lot of memory. It's not quite where it needs to be to replace a dedicated GPU, but in a few iterations it could be. I'm interested in other opinions. I'm no expert on this stuff.
  - jb1991 1y ago
    How does the shared memory model for GPUs on Apple Silicon factor into this? These are technically consumer grade and not very expensive, but they can offer a huge amount of memory since all the memory is shared between CPU and GPU, even a midtier machine can easily have 100 GB of GPU memory.
    - noelwelsh 1y ago
      If you squint the M4 is the same as the Strix Halo. The M4 has roughly * double the bandwidth; * half the compute; and * double the price for comparable memory (128GB) compared to the Strix Halo. I'm more interested in the AMD chips because of cost plus, while I have an Apple laptop, I do most of my work on a Linux desktop. So a killer AMD chip works better for me. If you don't mind paying the Apple tax then a Mac is a viable option. I'm not sure on the software side of LLMs on Apple Silicon but I cannot imagine it's unusable. An example of desktop with the Strix Halo is the Framework desktop (AI Max+ 395 is the marketing name for the Strix Halo chip with the most juice): https://frame.work/gb/en/products/desktop-diy-amd-aimax300/configuration/new https://frame.work/gb/en/products/desktop-diy-amd-aimax300/c...
ulfw 1y ago
They are a Chinese company based out of the city of Shanghai, not Singapore. They're also planning to IPO at HKEX in Hong Kong soon https://www.scmp.com/tech/tech-trends/article/3314819/deepseek-rival-minimax-says-its-first-ai-reasoning-model-halves-compute-r1?module=china_future_tech&pgtype=homepage https://www.scmp.com/tech/tech-trends/article/3314819/deepse...
- 7moritz7 1y ago
  I'll keep an eye out on that ipo
- thedudeabides5 1y ago
  ask it what country taiwan is part of...
freeqaz 1y ago
In a linked Twitter post[0], they trained this for $500k-ish. I wonder how? > RL at unmatched efficiency: trained with just $534,700 0: https://x.com/MiniMax__AI/status/1934637031193514237 https://x.com/MiniMax__AI/status/1934637031193514237

rfoo 1y ago

> A Singapore based company, according to LinkedIn Nah, this is a Shanghai-based company.

diggan 1y ago
[flagged]
- noelwelsh 1y ago
  https://en.wikipedia.org/wiki/MiniMax_(company) https://en.wikipedia.org/wiki/MiniMax_(company)
  - diggan 1y ago
    Wikipedia in itself is no source, and after reading parents message I went there to check to and surprise surprise, neither of the statements have sources attached to it. None of the linked articles have any information about where their headquarters is either. If someone knows of a trustworthy article that states it outright, please feel free to share.
    - noelwelsh 1y ago
      I'm the OP who claimed it was Singaporean, after checking LinkedIn. I then found the Wikipedia page, which I posted above. Amongst the comments here there is also a link to a Bloomberg article about a potential IPO. I don't have a dog in the race. Just passing on what I found.
      - nimchimpsky 1y ago
        [dead]
- Deathmax 1y ago
  https://www.minimaxi.com https://www.minimaxi.com is their website for the Chinese parent company 上海稀宇科技有限公司, https://minimax.io https://minimax.io is their international website for the Singapore based company Nanonoble Pte Ltd that handles operations outside of China.
- rfoo 1y ago
  What source do you want? I have a few friends who work for them and they all live in either Shanghai (most) or Beijing. And I've never seen anyone who claimed they are based in Singapore or anywhere else before. Does this work?

manc_lad 1y ago

It seems more and more like an inevitability we will run models locally. Exciting and concerning implications. If anyone has any suggestions of people thinking about this space they respect, I'd love to listen to more ideas and thoughts on the developments.

noelwelsh 1y ago
I think the main limitation, right now, is hardware. For GPUs the main limit is the VRAM available on consumer models. CPUs have plenty of memory but don't have the bandwidth or vector compute power for LLMs. This is why I think the Strix Halo is so exciting: it has bandwidth + compute power plus a lot of memory. It's not quite where it needs to be to replace a dedicated GPU, but in a few iterations it could be. I'm interested in other opinions. I'm no expert on this stuff.
- jb1991 1y ago
  How does the shared memory model for GPUs on Apple Silicon factor into this? These are technically consumer grade and not very expensive, but they can offer a huge amount of memory since all the memory is shared between CPU and GPU, even a midtier machine can easily have 100 GB of GPU memory.
  - noelwelsh 1y ago
    If you squint the M4 is the same as the Strix Halo. The M4 has roughly * double the bandwidth; * half the compute; and * double the price for comparable memory (128GB) compared to the Strix Halo. I'm more interested in the AMD chips because of cost plus, while I have an Apple laptop, I do most of my work on a Linux desktop. So a killer AMD chip works better for me. If you don't mind paying the Apple tax then a Mac is a viable option. I'm not sure on the software side of LLMs on Apple Silicon but I cannot imagine it's unusable. An example of desktop with the Strix Halo is the Framework desktop (AI Max+ 395 is the marketing name for the Strix Halo chip with the most juice): https://frame.work/gb/en/products/desktop-diy-amd-aimax300/configuration/new https://frame.work/gb/en/products/desktop-diy-amd-aimax300/c...

ulfw 1y ago

They are a Chinese company based out of the city of Shanghai, not Singapore. They're also planning to IPO at HKEX in Hong Kong soon https://www.scmp.com/tech/tech-trends/article/3314819/deepseek-rival-minimax-says-its-first-ai-reasoning-model-halves-compute-r1?module=china_future_tech&pgtype=homepage https://www.scmp.com/tech/tech-trends/article/3314819/deepse...

7moritz7 1y ago
I'll keep an eye out on that ipo
thedudeabides5 1y ago
ask it what country taiwan is part of...

freeqaz 1y ago

In a linked Twitter post[0], they trained this for $500k-ish. I wonder how? > RL at unmatched efficiency: trained with just $534,700 0: https://x.com/MiniMax__AI/status/1934637031193514237 https://x.com/MiniMax__AI/status/1934637031193514237