"Exactly those situations" you say while describing an entirely different sort of model. Your first clue that you're missing knowledge should have been the part

"Exactly those situations" you say while describing an entirely different sort of model. Your first clue that you're missing knowledge should have been the part where the thing that the well financed experts were doing didn't make sense to you. Your second clue should have been the part where what I was saying didn't seem to match up with your experience. I let you know that your were uninformed and even suggested a very low effort way that you might look into the matter. So why didn't you do that? A couple fairly arbitrary examples. A high performance zero shot TTS model can weigh in at well under 150 MiB. You can solve MNIST (ie perform OCR of handwritten english) to better than 99% accuracy with a sub-100 KiB model. Your LLM of choice will be able to provide you with plenty of others.