4 ms·
"Critically, the computational cost of trialing, training and testing the system was less than 300 USD dollars." Is this a joke? What exactly did he do? Train
by EGreg 4y ago
"Critically, the computational cost of trialing, training and testing the system was less than 300 USD dollars."
Is this a joke?
What exactly did he do? Training the system how? Does ChatGPT allow APIs, let alone training on some corpus of data?
- jncraton 4y agoOpenAI provides tools to fine-tune models: https://platform.openai.com/docs/guides/fine-tuning https://platform.openai.com/docs/guides/fine-tuning The largest Davinci model currently costs $0.03 per 1k of training tokens during fine-tuning, so you could fine-tune a model on 10M tokens for one epoch at a cost of $300.
- EGreg 4y agoWow! I can use this for forum moderation ... basically filtering user input through this to create "innocuous" and "more standardized" titles for events etc.