3 ms·
Great questions. We want to keep some of our technical details closer to the chest, so I won't go into the specific technologies we're using here. I will expan
by lumax15 4y ago
Great questions. We want to keep some of our technical details closer to the chest, so I won't go into the specific technologies we're using here.
I will expand a bit on fine-tuning. It's really hard to get this right, and the iteration speed is slow. Of course these companies can build their own, but we want to save them a lot of headache.
So far, we haven't found any off-the-shelf open source base model that works super well for code completions. We've augmented models with a huge amount of data in order to see our current performance, and we ran into a lot of pain along the way.