sweaterkokuro

2 ms·

1. 1.▲
   by sweaterkokuro 5mo ago

   This is cool, Id love to be able to fine tune on this architecture. Is this something on the roadmap ever?
2. 2.▲
   by sweaterkokuro 7mo ago

   In my experience its in all Language Models' nature to maximize token generation. They have been natively incentivized to generate more where possible. So if you dont put down your parameters tightly it will let loose. I usually put ha
3. 3.▲
   by sweaterkokuro 7mo ago

   As strong as current LLMs are they are easily distracted from the task often. At production scale, fine tuning can make a lot more sense given you provide the model a very specific task.
4. 4.▲
   by sweaterkokuro 2y ago

   This is awesome!