4 ms·

I developed an online course on serverless machine learning, where you can learn some of the principles of refactoring ML systems into separate feature/training

I developed an online course on serverless machine learning, where you can learn some of the principles of refactoring ML systems into separate feature/training/inference pipelines: https://github.com/featurestoreorg/serverless-ml-course https://github.com/featurestoreorg/serverless-ml-course Some of the students have built similar systems, for example chaining Whisper and ChatGPT or translation or sentiment analysis of transcribed text, such as here (transcribe Swedish and tell me the sentiment of the text): https://huggingface.co/spaces/Chrysoula/voice_to_text_swedish https://huggingface.co/spaces/Chrysoula/voice_to_text_swedis...

SiempreViernes 4y ago
Why is this type of cloud based computing called serverless? To me "putting all the work on remote machines you don't manage" seems pretty cloudy, and I naively expected "serverless" to mean something like runs locally, not "uses a shit town of someone else's servers".
- jamesblonde 4y ago
  Great question. I think of it as follows - if I can just write some operational Python code and "deploy" it, without needing to install/upgrade/maintain systems software (k8s/DB/feature-store/etc), then I have built a serverless system. What's cool now is lots of these services have great free tier and you can run serverless ML systems without paying anything.
- jwr 4y ago
  Good question. For me it's in the same category as "hoverboards" that don't actually hover.
- rospaya 4y ago
  A good analogy I heard is that serverless uses servers as much as wireless uses wires. It does, but it's not part of your responsibility.
  - jamesblonde 4y ago
    Nice. If anybody has installed and operated an MLFlow server (open source, great product), but then switched to use a serverless platform like weights and biases, you would instinctively get the term serverless. DynamoDB is called a serverless database. Obviously there are servers, it's just somebody else's job to maintain them.
pyfan878 4y ago
Thanks for sharing! will check it out later, but this looks great.

SiempreViernes 4y ago

Why is this type of cloud based computing called serverless? To me "putting all the work on remote machines you don't manage" seems pretty cloudy, and I naively expected "serverless" to mean something like runs locally, not "uses a shit town of someone else's servers".

jamesblonde 4y ago
Great question. I think of it as follows - if I can just write some operational Python code and "deploy" it, without needing to install/upgrade/maintain systems software (k8s/DB/feature-store/etc), then I have built a serverless system. What's cool now is lots of these services have great free tier and you can run serverless ML systems without paying anything.
jwr 4y ago
Good question. For me it's in the same category as "hoverboards" that don't actually hover.
rospaya 4y ago
A good analogy I heard is that serverless uses servers as much as wireless uses wires. It does, but it's not part of your responsibility.
- jamesblonde 4y ago
  Nice. If anybody has installed and operated an MLFlow server (open source, great product), but then switched to use a serverless platform like weights and biases, you would instinctively get the term serverless. DynamoDB is called a serverless database. Obviously there are servers, it's just somebody else's job to maintain them.

pyfan878 4y ago

Thanks for sharing! will check it out later, but this looks great.