linearalgebra45

4 ms·

1. 1.▲
   by linearalgebra45 4y ago

   "prompting experiments" is just my use-case. According to v64 a lot of people have had the same idea of spinning up a trial instance to run inference, which is unsurprising. I'm not in a position to put in any meaningful work
2. 2.▲
   by linearalgebra45 4y ago

   Would you mind publishing your notes/learnings once you gain enough understanding of this model?
3. 3.▲
   by linearalgebra45 4y ago

   > not the 65G model, but the smaller ones Haha, that's right! I saw that one too
4. 4.▲
   by linearalgebra45 4y ago

   What instance are you using?
5. 5.▲
   by linearalgebra45 4y ago

   You only get a single month-long window to spend the credit! And I'm sure not going to spend any of my own money on prompting experiments. I might be suffering from FOMO to some degree, I've just got to tell myself that this won&#
6. 6.▲
   by linearalgebra45 4y ago

   Are you sure about that? I can't remember where I saw the table of memory requirements, but I'm sure some of the larger instances here [1] will surely be able to cope (assuming they're available!) Oracle gives you a $300 free
7. 7.▲
   by linearalgebra45 4y ago

   It's been enough time since this leaked, so my question is why aren't there blog posts already of people blowing their $300 of starter credit with ${cloud_provider} on a few hours' experimentation running inference on this 65
8. 8.▲
   by linearalgebra45 4y ago

   Hypothetically, what would the consequences be if I ran this on my university's computing cluster?