4 ms·
"GPT-4.5 is not a frontier model, but it is OpenAI’s largest LLM, improving on GPT-4’s computational efficiency by more than 10x."[1] I don't get it, it is sup
by kristofferR 2y ago
"GPT-4.5 is not a frontier model, but it is OpenAI’s largest LLM, improving on GPT-4’s computational efficiency by more than 10x."[1]
I don't get it, it is supposedly much cheaper to run?
[1] https://cdn.openai.com/gpt-4-5-system-card.pdf https://cdn.openai.com/gpt-4-5-system-card.pdf (page 7, bottom)
- refulgentis 2y agoI speed up my algo that takes a bag-o'-floats by 10x. If I put 100x floats in my bag-o'-floats, its still 10x slower :( (extending beyond that point and beyond ELI5: computational efficiency implies multiplying the floats is faster, but you still need the whole bag o' floats, i.e no RAM efficiency gained, so you're still screwed on big-O for the # of GPUs you need to use)