3 ms·
> The total training time for DoctorGPT including supervised fine-tuning of the initial LLama model on custom medical data, as well as further improving it via
by bugglebeetle 3y ago
> The total training time for DoctorGPT including supervised fine-tuning of the initial LLama model on custom medical data, as well as further improving it via Reinforcement Learning from Constitional AI Feedback took 24 hours on a paid instance of Google Colab.
The most impressive part of this project is that they got Google Colab to not close the session for 24 hours straight.