4 ms·
Couldn't you create synthetic data based on your entries using local models? Or would that defeat the purpose of fine tuning it?
by SeanLang 6mo ago
Couldn't you create synthetic data based on your entries using local models? Or would that defeat the purpose of fine tuning it?
- embedding-shape 6mo agoYeah, I suppose, but how do I get sufficiently high quality synthetic data without sending the original data to OpenAI/Anthropic, or by using local models when none of them seem strong enough to be able to generate that "sufficiently high quality synthetic data" in the first place?
- mswphd 6mo agoyou could do something like rent GPU time yourself, and use it to run a higher-quality local model (e.g. one of the Chinese "close to frontier" ones). Not guaranteed to preserve privacy of course, but it at least avoids directly sending the data to OpenAI/Anthropic.
- embedding-shape 6mo agoI couldn't, as this is essentially handing over the most private I have, to 3rd parties. Don't really care about what country they're based in, it's not a possibility.