I have no experience with AI, but is this application very different from ltc or eth fpga mining? Do I get it right, that AI chip needs plenty of memory to hold

I have no experience with AI, but is this application very different from ltc or eth fpga mining? Do I get it right, that AI chip needs plenty of memory to hold coefficients, manipulate data, get next set of coefficients, repeat this multiple times and the bottleneck is memory bandwidth? Or it can be parallelized with more FPGAs for different layers with corresponding storage for coefficients.