4 ms·

Amethyst Mistral 13B q5 gguf is what I’m using most of the time now. Synthetic datasets are great to finetune with, there is no moat for having inaccessible lit

Amethyst Mistral 13B q5 gguf is what I’m using most of the time now. Synthetic datasets are great to finetune with, there is no moat for having inaccessible literature data sets I’m offline now because I’ve had too many ideas and domain names registered too soon after conversing with Chat GPT4 I’m open to the idea of people reacting to similar stimuli that cause ideas to be done at the same time, but I didn't like that experience and I can run these models on my M1 with LM Studio so easily I do think some chats get flagged when the model says something seems novel, like Albert Einstein working at the patent office. Not worth making it my whole identity in wanting to prove, just the catalyst I needed to try 7B and 13B models seriously and I’m quite pleased

deleted 3y ago
[deleted]
tarruda 3y ago
Is "Amethyst Mistral 13B" a llama fine tune? I searched for it on huggingface and only found the GGUF version, the link to the original model is broken
- Havoc 3y ago
  Mistral would be the base model
  - tarruda 3y ago
    Can a 7B base model be fine tuned into a 13B model? Mistral is 7B, this one is 13B.
    - Havoc 3y ago
      Two models can be merged from what I understand to result in different total param sizes. That’s different from a fine tune I gather the results of merges can be unpredictable though
dkarras 3y ago
you think OpenAI employees watch your conversations and register your domain names? Or that OpenAI has a system in place where they try to profit from registering domain names people talk about?
- yieldcrv 3y ago
  or somebody in between, yes. random contractor, intern, someone at the data center, an analytics package nobody put scrutiny on, who knows but the difference doesn't matter after the experience, its a vulnerability surface we all know exists and have to trust at all times no matter what assurance we get, as it could change at any time although I find the model to be very agreeable, it will disagree and generally tell me when it finds a concept "novel" if I identified a friction, I think certain words can be flagged for review to stand out in the sea of conversations it has

deleted 3y ago

[deleted]

tarruda 3y ago

Is "Amethyst Mistral 13B" a llama fine tune? I searched for it on huggingface and only found the GGUF version, the link to the original model is broken

Havoc 3y ago
Mistral would be the base model
- tarruda 3y ago
  Can a 7B base model be fine tuned into a 13B model? Mistral is 7B, this one is 13B.
  - Havoc 3y ago
    Two models can be merged from what I understand to result in different total param sizes. That’s different from a fine tune I gather the results of merges can be unpredictable though

dkarras 3y ago

you think OpenAI employees watch your conversations and register your domain names? Or that OpenAI has a system in place where they try to profit from registering domain names people talk about?

yieldcrv 3y ago
or somebody in between, yes. random contractor, intern, someone at the data center, an analytics package nobody put scrutiny on, who knows but the difference doesn't matter after the experience, its a vulnerability surface we all know exists and have to trust at all times no matter what assurance we get, as it could change at any time although I find the model to be very agreeable, it will disagree and generally tell me when it finds a concept "novel" if I identified a friction, I think certain words can be flagged for review to stand out in the sea of conversations it has