3 ms·

Who's the intended user for this? Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models? Is it a competitor to LMStudio?

mlnj 7mo ago
I am unaware lm studio is being used for fine tuning. I believe it only does inference. Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy. Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.
- danielhanchen 7mo ago
  Thanks! We do have normal AMD support for Unsloth but yes the UI doesn't support it just yet! Will keep you posted!
  - MrDrMcCoy 7mo ago
    What does "normal AMD support" mean here? I was completely unable to get it working on my Ryzen AI 9700 XT. I had to munge the versions in the requirements to get libraries compatible with recent enough ROCm, and it didn't go well at all. My last attempt was a couple weeks before studio was announced.
lastdong 7mo ago
From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”
huydotnet 7mo ago
you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.
- danielhanchen 7mo ago
  Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!
danielhanchen 7mo ago
You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference! We're complimentary to LM Studio - they have a great tool as well!
- TheTaytay 7mo ago
  I don’t know why this is being downvoted. Danielhanchen is legit, and unsloth was early to the fine-tuning on a budget party.
  - danielhanchen 7mo ago
    Haha no worries at all :)

mlnj 7mo ago

I am unaware lm studio is being used for fine tuning. I believe it only does inference. Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy. Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.

danielhanchen 7mo ago
Thanks! We do have normal AMD support for Unsloth but yes the UI doesn't support it just yet! Will keep you posted!
- MrDrMcCoy 7mo ago
  What does "normal AMD support" mean here? I was completely unable to get it working on my Ryzen AI 9700 XT. I had to munge the versions in the requirements to get libraries compatible with recent enough ROCm, and it didn't go well at all. My last attempt was a couple weeks before studio was announced.

lastdong 7mo ago

From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”

huydotnet 7mo ago

you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.

danielhanchen 7mo ago
Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!

danielhanchen 7mo ago

You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference! We're complimentary to LM Studio - they have a great tool as well!

TheTaytay 7mo ago
I don’t know why this is being downvoted. Danielhanchen is legit, and unsloth was early to the fine-tuning on a budget party.
- danielhanchen 7mo ago
  Haha no worries at all :)