3 ms·
> At Prodia, we've started to investigate building safety systems by checking if the input prompts are within a distance threshold of known adult or illegal con
by throwup238 3y ago
> At Prodia, we've started to investigate building safety systems by checking if the input prompts are within a distance threshold of known adult or illegal concepts.
This is why we can’t have nice AI things.
After my experience with RAG across a dozen models and god knows how many experiments against parts of Libgen’s archive in topics I’m familiar with, I’m not sure embeddings are actually useful for anything requiring any kind of accuracy. They’re great for low stakes purposes or as a step in a human driven workflow but like LLMs they’re a very fuzzy and often times inaccurate tool.
- batch12 3y agoI've had some luck with using embeddings for categorization and for fingerprinting authors. But yeah for retrieval alone the results have been mixed. I get better results there from smaller sized text comparisons and the results haven't been terrible, just not perfect.
- montyanderson 3y agoThat's really interesting. Was it hard to separate the semantic meaning from the author's style?
- batch12 3y agoBoth came into play, so not only what was talked about but how it was talked about. I ran through HN comments and when ranking authors by how similar they were to me, I found that the account I used years ago was within the top 10 or so closest users out of ~60k
- petra 3y agoCan you expand more on what processes you've used ? Because tools like elicit.org embedding based search seems pretty acurate.
- deleted 3y ago[deleted]
- montyanderson 3y agoI don't see why AI integrations shouldn't cater to a user's wants: there are a few things I don't want to see when generating images day-to-day. Using embeddings for safety filters lets you have uncensored models available in multiple modes depending on audience.