4 ms·
>>> 98% of collected data was rejected. I mean apart from wow ! 98% of the internet is shit (that’s higher than even I assumed) - how did they differentiate be
by lifeisstillgood 2y ago
>>> 98% of collected data was rejected.
I mean apart from wow ! 98% of the internet is shit (that’s higher than even I assumed) - how did they differentiate between good and shit? PageRank? Length? I can tell the difference between good writing and bad writing (and porn and erotica) but I have to read it using my brain based LLM - how did they do it ?
This leads to the whole open source, show us your training data thing
- creesch 2y agoVery cheap human labor in Africa: - https://time.com/6247678/openai-chatgpt-kenya-workers/ https://time.com/6247678/openai-chatgpt-kenya-workers/ - https://www.theguardian.com/technology/2024/apr/16/techscape-ai-gadgest-humane-ai-pin-chatgpt https://www.theguardian.com/technology/2024/apr/16/techscape... Another hidden aspect of the current LLM landscape.
- Mashimo 2y agoThe article says 90% of collected data. Not 98% of all internet. > discard as much as 90% of the data they initially collect for training models.