4 ms·
I posted about the Python library few hours after release. Great experience. Easy, fast and works well. I create a GIST with a quick and dirty way of generatin
by ivanfioravanti 3y ago
I posted about the Python library few hours after release. Great experience.
Easy, fast and works well.
I create a GIST with a quick and dirty way of generating a dataset for fine-tuning Mistral model using Instruction Format on a given topic: https://gist.github.com/ivanfioravanti/bcacc48ef68b02e9b7a4034161824287 https://gist.github.com/ivanfioravanti/bcacc48ef68b02e9b7a40...
- jumperabg 3y agoHow does this fine-tuning work? I can see that you are loading a train.jsonl file and the some instructions but is the output model generated or this is some kind of a new way of training the models?
- jerpint 3y agoThe gist is only to create the dataset not to fine tune
- LoganDark 3y agoGist isn't an acronym, it's a word. (e.g. "get the gist of things")
- pknerd 3y agocan we use it on cloud or I gotta download it locally? it might not work on my MacBook 2015 with 8GB ram
- eurekin 3y agoWhat's your observations about finetunes - are they really useful for anything practical? :)
- tinyhouse 3y agoDoes olana support fine-tuning? I assume not. (Not asking about finetuned models that I know they support)