5 ms·
One thing I'm 100% is that a cut off date doesn't exist for any large model, or rather there is no single date since it's practically almost impossible to achie
by dvfjsdhgfv 1y ago
One thing I'm 100% is that a cut off date doesn't exist for any large model, or rather there is no single date since it's practically almost impossible to achieve that.
- koolba 1y agoIndeed. It’s not possible stop the world and snapshot the entire internet in a single day. Or is it?
- tough 1y agoyou would have an append only incremental backup snapshot of the world
- gf000 1y agoYou can trivially maximal bound it, though. If the training finished today, then today is a cutoff date.
- dragonwriter 1y agoThat's... not what a cutoff date means. Cutoff date is an upper bound, not a promise that the model is trained on every piece of information set in a fixed form before that date.
- tonyhart7 1y agoits not a definitive "date" you cut off information, but more a "recent" material you can feed, training takes times if you waiting for a new information, of course you are not going ever to train
- sib 1y agoBut I think the general meaning of a cutoff date, D, is: The model includes nothing AFTER date D and not The model includes everything ON OR BEFORE date D Right? Definitionally, the model can't include anything that happened after training stopped.
- dvfjsdhgfv 1y agoThat's correct. However, it is almost meaningless in practice as it might as well mean that, say, 99,99% of the content is 2 years old and older, and only 0,01 was trained just before that date. So if you need functionality that's dependent on new information, you have to test it for each particular component you need. Unfortunately I work with new APIs all the time and the cutoff date is of no much use.