4 ms·
You can make small LLMs more performant than large ones like GPT-3 by fine-tuning on specific tasks or providing them tools to offload precise calculations: e.
by imranq 4y ago
You can make small LLMs more performant than large ones like GPT-3 by fine-tuning on specific tasks or providing them tools to offload precise calculations:
e.g. Toolformer: https://arxiv.org/abs/2302.04761 https://arxiv.org/abs/2302.04761
which uses APIs and functions to improve GPT-J beyond GPT-3 for various tasks
- 1letterunixname 4y agoHow dare you bring knowledge in here! Some people at work would be offended if they couldn't buy their A100 or DGX toys, or had to scale back their custom ASIC and systems R&D.