3 ms·
> AI models are literally just facts. Are they, or are they collections of probabilities? If they are probabilities, and those probabilities change from model
by margalabargala 2y ago
> AI models are literally just facts.
Are they, or are they collections of probabilities? If they are probabilities, and those probabilities change from model to model, that seems like they might be copywritable.
If Google, OpenAI, Facebook, and Anthropic each train a model from scratch on an identical training corpus, they would wind up with four different models that had four differing sets of weights, because they digest and process the same input corpus differently.
That indicates to me that they are not a collection of facts.
- ronsor 2y agoThe AI training algorithms are deterministic given the same dataset, same model architecture, and same set of hyperparameters. The main reasons the models would not be identical is due to differing random seeds and precision issues. The differences would not be due to any creative decisions.
- margalabargala 2y agoSure, but they don't all use the same algorithm, the same hyperparameters, etc. At some point, with sufficiently many hyperparameters being chosen, that starts becoming a creative decision. If 5 parameters are available and all are left at the default, then no, that's not creative. If there are ten thousand, and all are individually tweaked to yield what the user wants, is that creative? Not to mention all of these companies write their own algorithms to do the training which can introduce other small differences.