4 ms·
Tabby collected the source code from the related repository and built them into a dataset. I already have some proof-of-concept pipelines built [1] and [2], but
by wsxiaoys 4y ago
Tabby collected the source code from the related repository and built them into a dataset. I already have some proof-of-concept pipelines built [1] and [2], but I still need some time to polish the data pipeline..
[1]: https://github.com/TabbyML/tabby/blob/main/tabby/tools/repository/updater.py https://github.com/TabbyML/tabby/blob/main/tabby/tools/repos...
[2]: https://github.com/TabbyML/tabby/blob/main/tabby/tools/trainer/train_lora.py https://github.com/TabbyML/tabby/blob/main/tabby/tools/train...
- nathancahill 4y agoOk, looks like that makes sense! Is there a prompt token limit like OpenAI models? Codex I believe has a 8k prompt/response limit.
- skerit 4y agoYou can train this on all the code in your own repositories? I would assume that makes the completions a lot better?