7 ms·
I’ve been using gpt-4-1106-preview from the API (mostly to use retrieval) and it’s insanely slow. I can submit something and watch a YouTube it takes so long so
by pram 3y ago
I’ve been using gpt-4-1106-preview from the API (mostly to use retrieval) and it’s insanely slow. I can submit something and watch a YouTube it takes so long sometimes. I can’t imagine the issues they’re having trying to scale this, present drama excluded.
- icelancer 3y agoSame. gpt-4-1106-preview has been brutally slow, which is a bummer since as of a few days ago, it got a lot faster in our evals. I'm one of the lucky ones to have Claude API access but it's garbage for almost anything technical, so I don't use it. (Solid for writing and liberal arts stuff though) This whole nonsense around OpenAI made me sign up for Azure OpenAI access, which takes 10 days to get approved by their team (lol). I emailed my buddy who works at Microsoft Research and told him this was absurd, and in the form I used bunch of curse words and copy/pasted my OpenAI billing statement. I got approved in 12 hours. As usual, it's who you know in this industry...