3 ms·
Using an LLM doesn't mean it has to take the final decision. You can also use it as a warning system.
by amelius 7mo ago
Using an LLM doesn't mean it has to take the final decision. You can also use it as a warning system.
- stnikolauswagne 7mo agoIs there any indication that current warning systems are insufficient in any way that would be improved by LLM involvement?
- vidarh 7mo agoWe won't know that until someone has actually investigated how an LLM would do in those scenarios.
- stnikolauswagne 7mo agoThat sounds like a solution looking for a problem though, i see plenty of arguments against throwing critical safety information that are in charge of peoples lives into an LLM "just in case the result is better than the result that the current battle-hardened systems already provide"
- amelius 7mo agoNobody can be against just collecting the data and letting people experiment with it.
- stnikolauswagne 7mo agoAre all those security systems actually open right now? Because that sounds like an absolute security nightmare if so.
- amelius 7mo agoCan you give an example scenario?
- stnikolauswagne 7mo agoTo properly test an LLM based emergency system against the current as-is system there needs to be a way of verifying whether the LLM detected emergency is classed as an emergency as-is. If this information was available publicaly it could enable bad actors things like stress-testing the EMP-tolerance of the current systems or what level of malware infiltration is detected.
- captainbland 7mo agoWell they don't attract nearly as much investment in the current market, I think that might be the problem people really want to solve
- Mawr 7mo agoFalse negatives are a huge issue when designing safety systems. It is not the case that "more warnings = more better".
- amelius 7mo agoOf course, but an LLM can potentially help with that.