2 ms·
Have your tried running base models? I would try a base model instead of an instruct model it. I would prompt it like this: # Grammar correction .... :input:A
by throwawayffffas 2y ago
Have your tried running base models? I would try a base model instead of an instruct model it. I would prompt it like this:
# Grammar correction ....
:input:A couple of sentences from your text here:input:
:output:
And see what it fills in after the output.
>They always tend to add or remove sentences of there own.
You may be running into context size issues here. Try going small a sentence at a time. And using a new chat for each sentence.
btw: When I am saying a base model, I mean try using it in a text generation mode not a chat mode.
edit: There are models specifically trained for grammar correction though, for the multilingual case you may have to train one. See a link to an explanation of how someone did it for a google model from 2019: https://deeplearninganalytics.org/nlp-building-a-grammatical-error-correction-model/ https://deeplearninganalytics.org/nlp-building-a-grammatical...
- jiehong 2y agoRight, it seems some models are on hugging face for that: https://huggingface.co/grammarly/coedit-xl https://huggingface.co/grammarly/coedit-xl I'm gonna check those further