I found this Veritasium video interesting, about a company that is paring down models so they fit on analog chips, so the chips can be used in self-contained de

I found this Veritasium video interesting, about a company that is paring down models so they fit on analog chips, so the chips can be used in self-contained devices. It also appears that quantum computers may be even better for matrix math that transformers rely on. If all these hardware advances pan out... https://www.youtube.com/watch?v=GVsUOuSjvcg https://www.youtube.com/watch?v=GVsUOuSjvcg https://phys.org/news/2023-01-analog-quantum-previously-unsolvable-problems.html https://phys.org/news/2023-01-analog-quantum-previously-unso...