I'm also struggling a bit to get some decent code output (TS) from local LLMs via oobabooga. I've been getting mixed results and I think it's pretty sensitive t

I'm also struggling a bit to get some decent code output (TS) from local LLMs via oobabooga. I've been getting mixed results and I think it's pretty sensitive to the exact combo of model/parameters/prompt. If any one is off or not tuned to work with the others then results aren't great. E.g. some models expect very specific formatting of prompts. Some models give nonsense output at temperature=0.7 while others work great. Some models have been fine-tuned on chatbot-bot like instructions (ala chatgpt, so-called "Instruct" models) while others just autocomplete the given prompt. Very important to use the right combo to get the best results.