4 ms·
I’ve noticed an increase in services like this lately. What gives? Is there some sort of ML serverless offering made available on GCP?
by leshokunin 7y ago
I’ve noticed an increase in services like this lately. What gives? Is there some sort of ML serverless offering made available on GCP?
- radhakrsna 7y agoThis is v2 of the service that I launched last year. I am not aware of any ML serverless offering that does text summarization.
- leshokunin 7y agoOh interesting! So you made the summarization algorithm?
- ericlewis 7y agoNot exactly “serverless” but I built something similar with AWS SageMaker, which has elastic inference abilities. it’s rather fast to spin up and down. Also, when it comes to summarization- you don’t really need to infer each run, you can throw up a pretty simple caching system. Which means repeat requests are far cheaper and faster. I used cloudflare workers as a proxy / caching layer with KV in front of an AWS lambda to do article extraction and SageMaker spinup (with a small cache on the AWS side too- to catch in progress jobs)
- leshokunin 7y agoThat’s really interesting. Cool idea