4 ms·
nit: 40 Easy Crockpot dinners... more like 10 :p also they are all "healthier than the takeout" and full of flavour... Would love to hear how this works. Chec
by lee101 4y ago
nit: 40 Easy Crockpot dinners... more like 10 :p also they are all "healthier than the takeout" and full of flavour...
Would love to hear how this works.
Check out https://text-generator.io https://text-generator.io which is much cheaper than GPT-3 and still makes creative writing/code autocomplete.
You can dial up the repetition penalty or N to generate more sequences in a single request (and you are only charged by the request not by characters/tokens which helps), often generating N results is much more creative than generating a long result as the generated output gets fed into the input when generating long text and often causes that kind of repetitive looping.
So some tactics to mitigate that repetitiveness are:
* repetition_penalty/retries/seed
* Generate N results and combine instead of doing one big generate and trying to get 40 results and ending up with 10 similar ones
* Creative input prompts
There's probably other creative ways of getting variety by splitting the generation into different calls with higher repetition penalty as you get longer or looping detection etc. Its easy to detect repetition in the structured case like chat but hard when doing longer text generation/creative writing