4 ms·

How large of a model download would be required to remove the dependency on a cloud service?

• freeone3000 5y ago
  No more than 1GB, and inference would be dependent on the speed but no more than 10 seconds. Completely reasonable as a standalone program.
  • lrem 5y ago
    Would that require running a separate server locally? That's all kinds of non-techie hostile :(
  • Siira 5y ago
    Is there a guide on running it locally? I am currently using some classic algorithms to summarize my RSS feeds, but they aren’t very good.
    • freeone3000 5y ago
      Sure! Here's the weights https://huggingface.co/sshleifer/distilbart-cnn-12-6 https://huggingface.co/sshleifer/distilbart-cnn-12-6 , here's the model https://huggingface.co/transformers/model_doc/bart.html?#transformers.BartForConditionalGeneration https://huggingface.co/transformers/model_doc/bart.html?#tra... . Uses standard pytorch loading, so write your python program around that and it should be fine.