3 ms·
verifying/enforcing standards on inputs is not something that only AI unlocks, but LLMs are an example of huge step forward in this kind of work and I was expre
by npunt 3y ago
verifying/enforcing standards on inputs is not something that only AI unlocks, but LLMs are an example of huge step forward in this kind of work and I was expressing my general enthusiasm for the new tools we now have for these sorts of problems. We can turn relatively subjective content into much more computable semi-objective ratings through simple prompting (e.g. rate X on a scale of 0.0 to 1.0), which is valuable for all sorts of use cases. I'm using it right now for my work.
- pests 3y agoMay I ask how you are using it or what you are getting it to rate?
- npunt 3y agoRating content in a dataset to determine if we need to review it as I'm standardizing a large dataset right now to improve user experience. It's a relatively mundane activity but I think this is tentatively a good method. I've been exploring ways to use it for a bunch of ideas, like distance between ideas and reflecting back to users on how their messages might land with others. I think this idea of accelerating self reflection is a big use case for AI.
- maroonblazer 3y agoThis sounds interesting. Are there other examples of this out in the wild? Any plans to blog/write about it? I'm curious to learn more.
- npunt 3y agoI haven't seen any tho I haven't really been looking. Mostly it's messing with prompts and looking at data. I hope to write about it eventually, tho probably in the context of the self reflection use case. I don't think a lot of people are barking up this tree yet and it's important.
- itpnotllm 3y agoTao explicitly mentions that it is ITPs that unlock this. The ITPs will keep the LLMs in check, and stop them from bs-ing. The ITPs unlock massive collaboration.
- npunt 3y agoUm yes ITPs are the unlock for specifically math collaboration. I was referring to other more subjective fields that can also benefit from tech that allows collaboration to scale. LLMs have value for those. For math, LLMs suck.
- kaba0 3y agoI haven’t yet seen the video, nor am I familiar with the topic - could you please tell me what ITPs are? Edit: are they interactive theorem provers?
- chabulhwi 3y agoYes.