29 ms·
Which model are you using? I tried the deepseek 34b or whatever, but it goes nuts at times. Also, what params do you have for Prompt Context Size and Max Comple
by _boffin_ 3y ago
Which model are you using? I tried the deepseek 34b or whatever, but it goes nuts at times. Also, what params do you have for Prompt Context Size and Max Completion Tokens?
- ilc 3y agoCurrently Phind_Phind-CodeLlama-34B-v2, gonna try CodeBooga because, I can... that's the point. Use what ya like. 4k/32k, if I remember right. An interesting thing to do is actually try to use a true coding model in a chat. I had one model puking out its stack overflow training data, down to including user IDs. Oops.