AIUI, one of the most notable limitations of the first version of this model was that it couldn't Fill In The Middle (FIM), it could only provide completion.[0]

AIUI, one of the most notable limitations of the first version of this model was that it couldn't Fill In The Middle (FIM), it could only provide completion.[0] This blog post doesn't mention FIM either, so I guess that's still missing? The demos I've seen of Replit Ghostwriter indicate that it is still possible to get good results without FIM, as long as you have good enough software around the model, but I think FIM could still improve things further. The much smaller Refact-1.6B model supports FIM[1], and Refact-1.6B worked pretty well when I tested it a few weeks ago. People (like the most upvoted comment in this thread) who are expecting any of these small models to write entire programs for them based on a simple prompt seem to misunderstand the purpose of these smaller models, which is to be a smarter alternative for code completion. Writing entire functions or programs is better suited to much larger (and slower) instruct/chat-tuned models. [0]: https://huggingface.co/replit/replit-code-v1-3b/discussions/24 https://huggingface.co/replit/replit-code-v1-3b/discussions/... [1]: https://refact.ai/blog/2023/introducing-refact-code-llm/ https://refact.ai/blog/2023/introducing-refact-code-llm/