3 ms·
As another HN member said here: it is not always clear if people are talking about the ChatGPT web UI or App products or the GPT-4 API product. I feel like I h
by mark_l_watson 3y ago
As another HN member said here: it is not always clear if people are talking about the ChatGPT web UI or App products or the GPT-4 API product.
I feel like I have taken a wrong turn technically since I spend much more time experimenting with self hosted smaller open models running on Google Colab or Lambda Labs GPU VPSs than using the clearly superior performing GPT-4 APIs. I have been paid to work in the field of AI since 1982, and I should be desiring to use the very best models and technology, but open AI that can be self hosted just seems more interesting. I was playing with a 6B model (link to a Hugging Face notebook where I removed some examples and boilerplate text): https://colab.research.google.com/drive/1fMmXOcLdBzke-8Z0zl3j7UuAXKXNHSBf?usp=sharing https://colab.research.google.com/drive/1fMmXOcLdBzke-8Z0zl3... - really the best results I have seen from a small model.