danielhanchen

5 ms·

61.
by danielhanchen 6mo ago
Congrats on the launch!
62.
by danielhanchen 6mo ago
Oh nice! Glad it worked! Yes!! We're working on the app!
63.
by danielhanchen 6mo ago
Oh nice that's pretty good!
64.
by danielhanchen 6mo ago
Thanks! Oh nice! Ye local models are advancing much faster than I expected!
65.
by danielhanchen 6mo ago
Oh quants - haha I can re-investigate it - just totally forgot about them
66.
by danielhanchen 6mo ago
Haha! Ye the model is really good
67.
by danielhanchen 6mo ago
Thanks!
68.
by danielhanchen 6mo ago
You might be right, but Google's recommendation was temp 1 etc primarily because all their benchmarks were used with these numbers, so it's better reproducibility for downstream tasks
69.
by danielhanchen 6mo ago
Oh very cool! Will check the `--reasoning off` flag as well! Yep the models are really good!
70.
by danielhanchen 6mo ago
Appreciate it!
71.
by danielhanchen 6mo ago
Thank you and appreciate it!
72.
by danielhanchen 6mo ago
Yes UD-Q4_K_XL works well! :)
73.
by danielhanchen 6mo ago
Oh yes sadly we partially mis-communicated haha - there's both and synthetic data generation + exporting!
74.
by danielhanchen 6mo ago
Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!
75.
by danielhanchen 6mo ago
Apologies we just fixed it!! If you try again from source ie irm https://unsloth.ai/install.ps1 | iex it should work hopefully. If not - please at us on Discord and we'll help you! The Network error is a bummer - we&#x
76.
by danielhanchen 6mo ago
Thank you! I presume 24B is somewhat faster since it's only 4B activated - 31B is quite a large dense model so more accurate!
77.
by danielhanchen 6mo ago
Oh appreciate it! Oh nice! That sounds fantastic! I hope Gemma-4 will make it even better! The small ones 2B and 4B are shockingly good haha!
78.
by danielhanchen 6mo ago
Thanks! Have a super good day!!
79.
by danielhanchen 6mo ago
Thanks a lot for the support :) Tbh Gemma-4 haha - it's sooooo good!!! For teams - Google haha definitely hands down then Qwen, Meta haha through PyTorch and Llama and Mistral - tbh all labs are great!
80.
by danielhanchen 6mo ago
We're still updating it haha! Sorry! It's been quite complex to support new models without breaking old ones
81.
by danielhanchen 6mo ago
Thinking / reasoning + multimodal + tool calling. We made some quants at https://huggingface.co/collections/unsloth/gemma-4 for folks to run them - they work really well! Guide for those interested: https:&#
82.
by danielhanchen 7mo ago
Apologies on the delay - we fixed it! Please re-try with: curl -LsSf https://astral.sh/uv/install.sh | sh uv venv unsloth_studio --python 3.13 source unsloth_studio/bin/activate uv pip install unsloth --torch
83.
by danielhanchen 7mo ago
If you can try again we just updated the process sorry! We did a new pypi release: curl -LsSf https://astral.sh/uv/install.sh | sh uv venv unsloth_studio --python 3.13 source unsloth_studio/bin/activate uv pi
84.
by danielhanchen 7mo ago
Haha no worries at all :)
85.
by danielhanchen 7mo ago
Glad it was helpful!
86.
by danielhanchen 7mo ago
Oh will check and fix - thanks
87.
by danielhanchen 7mo ago
Hey! Our primary objective for now is to provide the open source community with cool and useful tooling - we found closed source to be much more popular because of better tooling! We have much much in the pipeline!!
88.
by danielhanchen 7mo ago
Thanks! We do have normal AMD support for Unsloth but yes the UI doesn't support it just yet! Will keep you posted!
89.
by danielhanchen 7mo ago
Hey will check ASAP and fix - sorry about that
90.
by danielhanchen 7mo ago
Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!

More ›