6 ms·
Unsloth Studio
- claaams 7mo agoWill check back when there's AMD support.
- jawerty 7mo agoExcited to use this been using unsloth models for the past couple years
- danielhanchen 7mo agoThank you for your continued support - we have much more planned for it!
- yomansat 7mo agoFYI, if any devs are around, the privacy policy still links to the gitbook.
- danielhanchen 7mo agoOh will check and fix - thanks
- meowokIknewit 7mo agoThe GUI for the fine tuning looks interesting. Hopefully this leads to a lot of new custom models
- danielhanchen 7mo agoThank you! We're still iterating on it so any suggestions are welcome!
- saberience 7mo agoWho's the intended user for this? Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models? Is it a competitor to LMStudio?
- mlnj 7mo agoI am unaware lm studio is being used for fine tuning. I believe it only does inference. Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy. Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.
- danielhanchen 7mo agoThanks! We do have normal AMD support for Unsloth but yes the UI doesn't support it just yet! Will keep you posted!
- MrDrMcCoy 7mo agoWhat does "normal AMD support" mean here? I was completely unable to get it working on my Ryzen AI 9700 XT. I had to munge the versions in the requirements to get libraries compatible with recent enough ROCm, and it didn't go well at all. My last attempt was a couple weeks before studio was announced.
- lastdong 7mo agoFrom the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”
- huydotnet 7mo agoyou just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.
- danielhanchen 7mo agoActually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!
- danielhanchen 7mo ago
- trvz 7mo agoInstalling with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem. This needs to go on homebrew or be a zip file with an app for manual download.
- DIVx0 7mo agoAgree with you, a slightly more maintainable way to use it now is with "uv" or mise. i've used `uv tool install unsloth` for this one.
- danielhanchen 7mo agoYep - uv is a better fit - and you get parallel downloads as well
- saagarjha 7mo agoIt's not just uv, it also will drop an nvm install in your home directory :(
- Computer0 7mo agoOn my linux systems I use venv to not affect system packages, is that not an option for this situation?
- beernet 7mo agoAgreed, feels like a vibe-coded frontend based on already given backend features. Also, never saw any Unsloth related software in production to this day. Feels strongly like a non-essential tool for hobby LLM wizards.
- danielhanchen 7mo agoYou would be surprised - we're the 4th largest independent distributor of LLMs in the world - and nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - we for example collab directly with large labs to release models with bug fixes.
- zokier 7mo agoWhat is unsloths business/income? They seem to be publishing lot of stuff for free, with no clear product to back them?
- deleted 7mo ago[deleted]
- danielhanchen 7mo agoHey! Our primary objective for now is to provide the open source community with cool and useful tooling - we found closed source to be much more popular because of better tooling! We have much much in the pipeline!!
- brainless 7mo agoThanks! How do you earn or keep yourself afloat? I really like what you guys are doing. And similar orgs. I am personally doing the same, full-time. But I am worried when I will run out of personal savings.
- richardw 7mo agoDaniel is a very impressive guy. Well within the realm of “fund the people not the idea” that YC seems to do. Got a few bucks from them and probably earning from collaborations etc. Odds of them not figuring out a business model seem slim. https://www.ycombinator.com/companies/unsloth-ai https://www.ycombinator.com/companies/unsloth-ai
- sowbug 7mo agoFrom comments elsewhere in this thread, it sounds like Unsloth could also be getting some decent consulting revenue from larger companies.
- reactordev 7mo agoThe opportunity here is HUUUUGGGEEEE!!! Companies have no idea what they are doing, they know they need it, they know they want it, engineers want it, they don’t have it in their ecosystem so this is a perfect opportunity to come in with a professional services play. We got you on inference training/running, your models, all that, just focus on your business. Pair that with huggingface’s storage and it’s a win/win.
- car 7mo agoCan Unsloth Studio use already downloaded models?
- nodja 7mo agoIDK how it did but it detected my LM studio downloaded models I have on a spinning drive (they're not in the default location).
- car 7mo agoTried to build from source on MacOS, but got this error: (base) unsloth git:(main) unsloth studio setup ╔══════════════════════════════════════╗ ║ Unsloth Studio Setup Script ║ ╚══════════════════════════════════════╝ Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install. Node v25.8.1 | npm 11.11.0 npm run build failed (exit code 2): > unsloth-theme@0.0.0 build > tsc -b && vite build src/features/chat/shared-composer.tsx(366,17): error TS6133: 'status' is declared but its value is never read.
- danielhanchen 7mo agoHey will check ASAP and fix - sorry about that
- danielhanchen 7mo agoApologies on the delay - we fixed it! Please re-try with: curl -LsSf https://astral.sh/uv/install.sh https://astral.sh/uv/install.sh | sh uv venv unsloth_studio --python 3.13 source unsloth_studio/bin/activate uv pip install unsloth --torch-backend=auto unsloth studio setup unsloth studio -H 0.0.0.0 -p 8888
- car 7mo agoThank you for the follow up! Big fan of your models here, thanks for everything you are doing! Works fine on MacOS now (chat only). On Ubuntu 24.04 with two GPU's (3090+3070), it appears that Llama.cpp sometimes uses the CPU and not GPU. This is judging from the tk/s and CPU load for identical models run with US-studio vs. just Llama.cpp (bleeding edge).
- illusive4080 7mo agoApache license. Can’t wait to try it out at work! LMStudio’s proprietary license makes getting permission hard.
- halJordan 7mo agoSome of it is Apache
- smcnally 7mo agoSome of unsloth studio’s code is Apache? Or some of lmstudio is?
- mkl 7mo agoFrom the README at https://github.com/unslothai/unsloth https://github.com/unslothai/unsloth: "Unsloth uses a dual-licensing model of Apache 2.0 and AGPL-3.0. The core Unsloth package remains licensed under Apache 2.0, while certain optional components, such as the Unsloth Studio UI are licensed under AGPL-3.0."
- illusive4080 7mo agoGood to know. AGPL is fine at my workplace too, whereas the custom LMStudio license has been in review since mid January with no ETA in sight.
- solomatov 7mo agoWhat do you mean by custom LMStudio license? Your employer requires reviews of proprietary EULAs or do you try to get a custom licensing deal from LMStudio?
- illusive4080 7mo agoEmployer must review all EULA terms, yes. The license is a hand crafted proprietary license not a standard OS license.
- jacquesm 7mo agoUnsloth is the real thing. Highly recommended for those running their own AI engines and that want to get the most out of them.
- yacin 7mo agowish there were an option to disable the annoying startup messages with emojis when using the library.
- smissingham 7mo ago[dead]
- ma2kx 7mo agoNice! Is there something planned to run the finetuning via hf jobs or runpod?
- peddling-brink 7mo agoThis looks really cool. Any chance you'll support pretraining runs as well?
- cboyardee 7mo ago[dead]
- deleted 7mo ago[deleted]
- kuon 7mo agoI hope you will support AMD. This looks Nice but I went the complicated route with AMD GPUs.
- MrDrMcCoy 7mo agoThey state that they're working on it. I'm waiting, too.
- fl0id 7mo agoDoes it use gpu support on mac? At least when running setup, it said cpu only.
- keyle 7mo agoI noticed the training part, that was interesting for my use case. Unfortunately it's said 'on NVIDIA'. Is there an alternative, tutorial, or project you'd recommend that would help me do supervised fine tuning (SFT) with the metal stack / macOS?
- TiredOfLife 7mo agoUse that mac to rent Nvidia gpus
- kahrl 7mo agolol.
- syntaxing 7mo ago> Mac: Like CPU - Chat only works for now. MLX training coming very soon
- MrDrMcCoy 7mo agoThey state further down that they're working on non-Nvidia support. Looking forward to it, since I'm pretty heavily invested in suffering on AMD (ROCm sucks, but everything else about AMD is worth it to me.).
- deleted 7mo ago[deleted]
- Havoc 7mo agoCongrats to team. Busy build a dataset for training so will def test it out
- maxothex 7mo ago[dead]
- ontouchstart 7mo agoI still have trouble to get unsloth studio setup working on my MacBook because of Python tooling issues. However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases: https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c24e9f3c7f1 https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2... https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e972083534a https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9... Very interesting. Will do it again next week if I can get unsloth studio working.
- danielhanchen 7mo agoIf you can try again we just updated the process sorry! We did a new pypi release: curl -LsSf https://astral.sh/uv/install.sh https://astral.sh/uv/install.sh | sh uv venv unsloth_studio --python 3.13 source unsloth_studio/bin/activate uv pip install unsloth==2026.3.7 --torch-backend=auto unsloth studio setup unsloth studio -H 0.0.0.0 -p 8888
- ontouchstart 7mo agoThank you Daniel. Here is the error message on my machine: https://gist.github.com/ontouchstart/86ca3cbd8b6b61fa0aeec75d09882ea7 https://gist.github.com/ontouchstart/86ca3cbd8b6b61fa0aeec75... It seems we might need more instructions on how to set up python (via uv) in vanilla MacOS.
- ontouchstart 7mo agoI have been updating the gist above and will stop this ``` ../scipy/meson.build:274:9: ERROR: Dependency lookup for OpenBLAS with method 'pkgconfig' failed: Pkg-config for machine host machine not found. Giving up. ``` Too much work.
- ontouchstart 7mo agoDaniel, it works now. Thanks for the hard work! https://gist.github.com/ontouchstart/532312fcba59aec3ce7f6aaee335eb57 https://gist.github.com/ontouchstart/532312fcba59aec3ce7f6aa...
- pentagrama 7mo agoLM Studio user here. Unsloth looks great, wanted to check it out, but there is no app file to download and install? Sorry I'm not familiar with the command line.