9 ms·

Thanks for your feedback. You can run local models on the instance. https://medium.com/@viplav.fauzdar/running-multiple-open-source-llms-on-ocis-free-arm-tier-w

• Jamesbeam 8mo ago
  Technically, you can also put diesel in a regular gas car. Is that a good idea? Nope. Don’t try to move the goalposts here. If those local models with 4b params could do anything useful in the broader range of having a "personal ai assistant" (your words) then why use the 20$ Claude pro subscription and not the local models? We both know the answer. You wanted to provide a Tutorial for a 0$ instance "working ai assistant", that could actually do things like "check email, manage files, run scripts". According to your own words. Now please prove it that you can run a useful ai assistant at 0$ with those local models.
  • nacs 8mo ago
    Local models are quite capable. Obviously a 4B model isn't going to do the job of a trillion parameter SOTA model but there are many local models that are both fast and very usable for these agentic flows. Qwen 30B and GLM Flash (also around 30B) are both very good for example and I use them regularly.