3 ms·
From https://twitter.com/OfficialLoganK/status/1694062949177139610 https://twitter.com/OfficialLoganK/status/169406294917713961... Early testers have reduced p
by Xenoamorphous 3y ago
From https://twitter.com/OfficialLoganK/status/1694062949177139610 https://twitter.com/OfficialLoganK/status/169406294917713961...
Early testers have reduced prompt size by up to 90% by fine-tuning instructions into the model itself, speeding up each API call and cutting costs.
I wonder if that 90% is precisely due to the calculation you made.