6 ms·
> "Think about it: how can a small number of specialized experts, who hand write and tune assembly code, possibly scale their work to all the different configur
by photochemsyn 4y ago
> "Think about it: how can a small number of specialized experts, who hand write and tune assembly code, possibly scale their work to all the different configurations while also incorporating their work into all the AI frameworks?! It’s simply an impossible task."
Naively, I wonder if this is the kind of problem that AI itself can solve, which is a rather singularity-approaching concept. Maybe there's too much logic involved and not enough training data on different configurations for that to work? A bit spooky however, the thought of self-bootstrapping AI.
- bigbillheck 4y agoThis is the kind of problem AI's been solving for 25 years and more: https://www.fftw.org https://www.fftw.org
- dimatura 4y agoThere has been work on using AI for this at various levels - at the neural architecture level (finding neural architectures with high throughput/latency for a given hardware), at the algorithm level (finding faster matrix multiplication routines), and at the hardware level (iirc Google stated the latest version of google TPUs were partially designed with AI).