3 ms·
For loops in AI are actually only there to implement continuous mathematical operations such as matrix multiplications in a single core. Modern AI chips and imp
by sudosysgen 6y ago
For loops in AI are actually only there to implement continuous mathematical operations such as matrix multiplications in a single core. Modern AI chips and implementations use very little to no for loops.
- LdSGSgvupDV 6y agoSorry, maybe it is a wrong analogy. What I want to emphasize is that there is no calculating time in nature. At least, we could not feel "lag" in our "Nature Server". For the part of chips, did you mean that it runs the "for loop" as parallel in each micro-chip (or gate or whatever tiny structure it is)?
- sudosysgen 6y ago>Sorry, maybe it is a wrong analogy. What I want to emphasize is that there is no calculating time in nature. At least, we could not feel "lag" in our "Nature Server". Yes, but the reality is that there is lag in our projection of what nature is and that we just ignore it. Different parts of our perception actually don't exist at the same instant. >For the part of chips, did you mean that it runs the "for loop" as parallel in each micro-chip (or gate or whatever tiny structure it is)? Pretty much, the for-loop is unfolded and ran in parallel.