4 ms·
Isn't "two models slapped together" basically how all of these things work, starting with CLIP? Not sure about GPT4o, obviously, I don't think they released any
by maciejgryka 2y ago
Isn't "two models slapped together" basically how all of these things work, starting with CLIP? Not sure about GPT4o, obviously, I don't think they released any underlying architecture details?
- whimsicalism 2y agoYour understanding is correct, even GPT4o will have an encoder model.
- tkellogg 2y agowhat even is “a model”? I’m not sure there is a technical definition that corresponds to how it’s used by the tech public - single interconnected neural network (LLM attention layers break this, autoencoders complicate this) - single training pass (LLMs have multiple passes, GANs have a single but produce multiple models)
- whimsicalism 2y ago> - single training pass (LLMs have multiple passes, GANs have a single but produce multiple models) LLMs have multiple passes? wdym?