I know of teams that spent over a year trying to build a generic import system on streams, at multiple companies, and in both cases they should have just stood

I know of teams that spent over a year trying to build a generic import system on streams, at multiple companies, and in both cases they should have just stood up a simple service on boxes with a lot of ram and auto scaling. Load CSV into memory. Done.