Local could also mean self hosted. The obvious optimization for the case presented would be to generate all the summaries on a server instead of in the client.

Local could also mean self hosted. The obvious optimization for the case presented would be to generate all the summaries on a server instead of in the client. Then the totally used compute would scale with the number of articles instead of number of users.