You would be surprised - we're the 4th largest independent distributor of LLMs in the world - and nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - we for example collab directly with large labs to release models with bug fixes.
I recommend installing uv first, then you can install any Python code you want inside a virtual environment to keep it isolated from the rest of the system.
Yep uv pip install unsloth works as well - we probably should have just made that the default - in fact Unsloth makes its own venv using UV if you have it dynamically
You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference!
We're complimentary to LM Studio - they have a great tool as well!
Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!
This needs to go on homebrew or be a zip file with an app for manual download.
We come from Python land mainly so packaging and distribution is all very new to us - homebrew will definitely be next!
Also, never saw any Unsloth related software in production to this day. Feels strongly like a non-essential tool for hobby LLM wizards.
uv init
uv add unsloth
uv run main.py % or whatever
Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?
Is it a competitor to LMStudio?
We're complimentary to LM Studio - they have a great tool as well!
Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy.
Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.