6 ms·
Twitter is full of low-quality garbage, partly due to the culture and partly due to the format. I am very doubtful that it has much value for LLM pretraining O
by anon373839 3y ago
Twitter is full of low-quality garbage, partly due to the culture and partly due to the format. I am very doubtful that it has much value for LLM pretraining OR fine-tuning.
- agnosticmantis 3y agoThat’s a good point. I think (in jest) the data is invaluable for training automated trolls, for which various state actors should be willing to pay good money. But more seriously, maybe the value is in it being a real-time source of new data, albeit the signal is drowned in noise like a needle in a hay stack.