6 ms·

> The models were only shown the first 10,000 characters from each document, or approximately 2,500 words. Experts were confused by this, noting that OpenAI mod

> The models were only shown the first 10,000 characters from each document, or approximately 2,500 words. Experts were confused by this, noting that OpenAI models support inputs over 50 times that size. Lavingia said that he had to use an older AI model that the VA had already signed a contract for. wow

ulrikrasmussen 1y ago
It also appears that they were really trying to do just basic data extraction and classification with some confusing analysis of ill-defined "munchability" thrown in. Most of the data could reliably be sourced from structured databases already, making the use of AI pointless. Even if you are limited by context length, why not just run your data extraction task over a sliding window and merge the results after? Reading the article, I got the impression that this was done by a junior developer mindlessly doing broscience. But apparently this guy is supposed to have helped build Pinterest and should thus be expected to not be an incompetent moron.