3 ms·

Yeah I refuse to give Oracle a dime, so I'll keep that in mind. I only run the tiny models for fun (the CPU inference is enough) and any complex coding tasks g

Yeah I refuse to give Oracle a dime, so I'll keep that in mind. I only run the tiny models for fun (the CPU inference is enough) and any complex coding tasks go through GPT or Claude. Mainly just using the one instance as another backup server, run scrapers, host a bunch of containers, and experiment with networking services. I don't see a reason to split up my one instance, but maybe in the future.

ipaddr 2y ago
What model are you running? I found it to be too slow.
- bottom999mottob 2y ago
  SmolLM v2 1.7GB Q8 has been running pretty fast. Only needs about 3.5GB of memory. I think it's fine for chatting, but it's only really good for Python code compared to larger models. Deepseek-coder is pretty slow, even with the quantized models. https://huggingface.co/blog/smollm https://huggingface.co/blog/smollm
SOLAR_FIELDS 2y ago
Yeah the main reason that I’m interested in using OCI is because it’s free and it actively takes money away from them by me doing this. So I will happily continue to take advantage of Larry, I know he would do the exact same to me but many times worse. So it’s a great solution as long as it lasts. I get to make Larry inconsequentially poorer every second my stuff runs, plus I get some free cloud compute. Win win
- bottom999mottob 2y ago
  Making Larry lose money while you sleep, truly a reverse Uno :)
- kstrauser 2y ago
  This is the first thing I’ve ever read that has me considering spinning up an OCI setup.
  - SOLAR_FIELDS 2y ago
    It’s a use case half driven by value and half driven by spite, and 100% about selfishly taking things at the detriment of others - which just feels so perfectly on brand for everything having to do with Larry Ellison. A microdose of his own medicine, if you will
shiroiushi 2y ago
>Yeah I refuse to give Oracle a dime The parent only paid $0.01. Even $0.10 should be fine, even if you strongly dislike Oracle: the cost to Oracle for charging your card $0.10 is more than that, so they're actually losing money by charging you such a small amount!

ipaddr 2y ago

What model are you running? I found it to be too slow.

bottom999mottob 2y ago
SmolLM v2 1.7GB Q8 has been running pretty fast. Only needs about 3.5GB of memory. I think it's fine for chatting, but it's only really good for Python code compared to larger models. Deepseek-coder is pretty slow, even with the quantized models. https://huggingface.co/blog/smollm https://huggingface.co/blog/smollm

SOLAR_FIELDS 2y ago

Yeah the main reason that I’m interested in using OCI is because it’s free and it actively takes money away from them by me doing this. So I will happily continue to take advantage of Larry, I know he would do the exact same to me but many times worse. So it’s a great solution as long as it lasts. I get to make Larry inconsequentially poorer every second my stuff runs, plus I get some free cloud compute. Win win

bottom999mottob 2y ago
Making Larry lose money while you sleep, truly a reverse Uno :)
kstrauser 2y ago
This is the first thing I’ve ever read that has me considering spinning up an OCI setup.
- SOLAR_FIELDS 2y ago
  It’s a use case half driven by value and half driven by spite, and 100% about selfishly taking things at the detriment of others - which just feels so perfectly on brand for everything having to do with Larry Ellison. A microdose of his own medicine, if you will

shiroiushi 2y ago

>Yeah I refuse to give Oracle a dime The parent only paid $0.01. Even $0.10 should be fine, even if you strongly dislike Oracle: the cost to Oracle for charging your card $0.10 is more than that, so they're actually losing money by charging you such a small amount!