Yay. ML makes programming fun again. Waiting for model releases feels like waiting for your favorite band to drop a new album. Being multimodal is a big step.

Yay. ML makes programming fun again. Waiting for model releases feels like waiting for your favorite band to drop a new album. Being multimodal is a big step. So is hitting the 1T parameter milestone. I’d love to see what they deploy this beast on; 8xA100 is still only 8x80GB = 640GB. Actually, I only heard rumors of it being 1T, so I wonder if openai has mentioned it anywhere… EDIT: the GPT-4 paper is pretty fascinating: https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf Scroll all the way to the bottom for some examples of problematic prompts that it’s trained to avoid.