3 ms·
I wasn't suggesting you need the LLM to perform sentiment analysis. The problem the LLM overcomes is generating the training data you need without having to tru
by cheschire 2y ago
I wasn't suggesting you need the LLM to perform sentiment analysis. The problem the LLM overcomes is generating the training data you need without having to trudge through massive amounts of material to mark a comment / thread with a 1 or a 0.
There's no scraping cost, the API is free. Your message, for example, is here:
https://hacker-news.firebaseio.com/v0/item/40801233.json?print=pretty https://hacker-news.firebaseio.com/v0/item/40801233.json?pri...
Processing 10,000 threads is probably not more than a few dollars on OpenAI's GPT API.
The reason I don't do it is I don't see the trend you see.