4 ms·
We currently can't do "AI safety" even in bleeding edge alignment research so investing into some startups in that area is just burning money. Current LLMs/ViTs
by storus 9mo ago
We currently can't do "AI safety" even in bleeding edge alignment research so investing into some startups in that area is just burning money. Current LLMs/ViTs have non-zero probability of producing something unsafe and it's their inherent trait.
- zer00eyz 9mo ago> Current LLMs/ViTs have non-zero probability of producing something unsafe Show me on the LLM where the "unsafe" result is that doesn't already exist inside its training data set? Go ahead I will wait.
- soco 9mo agoJust so I understand your comment, are you trying to say that the money on safety should go first into research? And not into a later startup, which is just putting lipstick on the pig? I agree to this understanding, no doubt about it.
- storus 9mo agoBasically yes. First figure out how to do reliable models that can be well-aligned with safety expectations, then invest into a startup that brings that tech to the industry.