4 ms·

With other software, devs convince their managers of the importance of using open source stuff in their stack. With AI, it's usually managers choosing what mode

by culi 17d ago

With other software, devs convince their managers of the importance of using open source stuff in their stack. With AI, it's usually managers choosing what models to use for the devs. The US labs don't need to give a damn how much devs like open source

noir_lord 17d ago
> The US labs don't need to give a damn how much devs like open source In the short term, true. In the long term, unknown but typically when you hold progress that way while other countries don't you at best end up becoming siloed while the rest of the world continues on without you.
impulser_ 17d ago
This isn't about liking open source. This is about the labs just being cool and doing cool shit instead of the opposite which is Anthropic where all they talking about is killing everyone and taking everyone's job.
- dlisboa 16d ago
  These labs are still (for the time being) made of people, who reflect their lives onto the work. The US population is much more pessimistic and doomsday driven these days, whereas the Chinese are more optimistic and future driven.
- culi 16d ago
  > This is about the labs just being cool and doing cool shit The point still stands. Devs like "cool shit". Upper management doesn't care
  - impulser_ 16d ago
    Well maybe they should because companies that do cool shit tend to attract people wanting to do cool shit and those are the people you want to be working at your company. Unless you want your company to become Google which use to do cool shit but now they dont and now they don't have a single person at the company that can build cool shit so they just release a bunch of lame shit.
reddec 16d ago
I was dev, and now I am Senior level manager. Open Weight models are current main focus for many companies with full alignment with top management for very simple reasons: - stable and predictable performance (no pre-launch models degradation) - ability to tune them for specific business cases (though still rare tbh) - better (at least 60% Opus vs Kimi (real,3rd party)) and more competitive pricing - flat pricing if tokenusage is big enough to justify renting GPU - decent quality - much higher guarantees that data will not be sent somewhere (assuming 3rd party inference providers) - and cherry on top: flat and minimal pricing with absolute confidentiality using Alibaba Apsara stack of recently released AMD Instinct Coder box[1] [1] https://www.amd.com/en/ecosystem/oem/supermicro/amd-instinct-coder.html https://www.amd.com/en/ecosystem/oem/supermicro/amd-instinct...

by culi 17d ago

noir_lord 17d ago

> The US labs don't need to give a damn how much devs like open source In the short term, true. In the long term, unknown but typically when you hold progress that way while other countries don't you at best end up becoming siloed while the rest of the world continues on without you.

impulser_ 17d ago

This isn't about liking open source. This is about the labs just being cool and doing cool shit instead of the opposite which is Anthropic where all they talking about is killing everyone and taking everyone's job.

dlisboa 16d ago
These labs are still (for the time being) made of people, who reflect their lives onto the work. The US population is much more pessimistic and doomsday driven these days, whereas the Chinese are more optimistic and future driven.
culi 16d ago
> This is about the labs just being cool and doing cool shit The point still stands. Devs like "cool shit". Upper management doesn't care
- impulser_ 16d ago
  Well maybe they should because companies that do cool shit tend to attract people wanting to do cool shit and those are the people you want to be working at your company. Unless you want your company to become Google which use to do cool shit but now they dont and now they don't have a single person at the company that can build cool shit so they just release a bunch of lame shit.

reddec 16d ago

I was dev, and now I am Senior level manager. Open Weight models are current main focus for many companies with full alignment with top management for very simple reasons: - stable and predictable performance (no pre-launch models degradation) - ability to tune them for specific business cases (though still rare tbh) - better (at least 60% Opus vs Kimi (real,3rd party)) and more competitive pricing - flat pricing if tokenusage is big enough to justify renting GPU - decent quality - much higher guarantees that data will not be sent somewhere (assuming 3rd party inference providers) - and cherry on top: flat and minimal pricing with absolute confidentiality using Alibaba Apsara stack of recently released AMD Instinct Coder box[1] [1] https://www.amd.com/en/ecosystem/oem/supermicro/amd-instinct-coder.html https://www.amd.com/en/ecosystem/oem/supermicro/amd-instinct...