Maybe that's the point? Their blog post didn't explain exactly how they plan to deal with this issue. As others have mentioned when their blog post was on HN it

Maybe that's the point? Their blog post didn't explain exactly how they plan to deal with this issue. As others have mentioned when their blog post was on HN it was missing the 'conclusion', which is maybe what they are hyping up for their launch? But otherwise it seems at a minimum they are aware of this problem. > But as you can see, solving this problem is not easy. Diversity in hardware, models, and data means that every existing solution on the market is only just a “point solution” to a much broader problem. https://www.modular.com/blog/ais-compute-fragmentation-what-matrix-multiplication-teaches-us https://www.modular.com/blog/ais-compute-fragmentation-what-...