30 ms·
Open source "AI" is a proxy for democratising and making (much) more widely useful the goodies of high performance computing (HPC). The HPC domain (data and co
by openrisk 2y ago
Open source "AI" is a proxy for democratising and making (much) more widely useful the goodies of high performance computing (HPC).
The HPC domain (data and compute intensive applications that typically need vector, parallel or other such architectures) have been around for the longest time, but confined to academic / government tasks.
LLM's with their famous "matrix multiply" at their very core are basically demolishing an ossified frontier where a few commercial entities (Intel, Microsoft, Apple, Google, Samsung etc) have defined for decades what computing looks like for most people.
Assuming that the genie is out of the bottle, the question is: what is the shape of end-user devices that are optimally designed to use compute intensive open source algorithms? The "AI PC" is already a marketing gimmick, but could it be that Linux desktops and smartphones will suddenly be "ΑΙ natives"?
For sure its a transformational period and the landscape T+10 yrs could be drastically different...
- frabcus 2y agoUnfortunately it is barely more open source than Windows. Llama 3 weights are binary code and while the license is pretty good it isn't open source.