4 ms·
Neural networks are great at optimizing when the objectives are agreed upon and well known, and will not abuse power for their own gain (that is one objective).
by seydor 3y ago
Neural networks are great at optimizing when the objectives are agreed upon and well known, and will not abuse power for their own gain (that is one objective).
Why would you want humans instead?
- hammyhavoc 3y agoBecause human beings understand the way the world works, but an LLM only deals in language, whereas societies, economies et al are incredibly complex and nuanced, and also not defined by language. Whilst a hypothetical application of a neural network politically may not abuse power for its own gain, that doesn't preclude it from making uninformed decisions, just like being a human being doesn't preclude someone from making poor decisions. How would constituents hold a neural network accountable? All kinds of shitty things could be done "because the neural net says so", and that lack of accountability is in and of itself a fundamental problem, especially the lack of human-readable data set as it is stored as tokens, it's only the output that is human-readable, so we wouldn't even be able to tell in what ways it had been manipulated. The ultimate patsy and scapegoat for real human beings to take advantage of.
- InitialLastName 3y ago> when the objectives are agreed upon and well known, The above is inherently not a feature of the problems that political systems are intended to solve.
- seydor 3y agowhat are political systems trying to solve?
- InitialLastName 3y agoIf the solution to a problem is obvious and agreed upon by everyone, you don't need political mechanisms to make a decision. Politics is best-suited to issues of resource contention and coordination that aren't distillable to a clear set of goals that everyone agrees on.
- seydor 3y agoWe can agree on mechanisms to accept or reject solutions, which is basically what representatives do. An AI can be a representative, subject to election like humans do. There is nothing inherently superior about flesh and blood. A political AI will be more measurable, more transparent and probably a lot more intelligent
- hammyhavoc 3y agoWhy would it be more transparent if the data isn't human-readable and only the output is? Thus you can never know how it may have been interfered with, whereas politicians leave a paper trail. A hypothetical AGI could well be more intelligent, but an LLM lacks all the qualities required to be a politician of any description.
- seydor 3y agomaybe i live in a different universe but very little is transparent about elected politicians, while we can always demand model to provide measures of its performance to guarantee that it is optimizing and not degrading