4 ms·
Nope. It's an end-to-end solution that doesn't have the ability to classify tokens into separate categories, such as maths vs. text. There's no way for it to s
by qayxc 4y ago
Nope. It's an end-to-end solution that doesn't have the ability to classify tokens into separate categories, such as maths vs. text.
There's no way for it to separate calculations from other transformations and thus it cannot delegate calculations to a different subsystem.
This can also be seen as a security feature, as arbitrary calculation is by nature unbounded in terms of complexity and memory use. There are calculations that seem simple, never exceed a reasonable value range, yet take ages to compute. Since it's impossible to identify such functions by simply looking at them, it'd be a great way of basically performing a DoS-attack on the model.
- ben_w 4y agoChatGPT, at a UI level, does tag code as code; so even though the LLM part doesn't itself have the capacity to delegate, it can certainly be used in this way as part of a larger system.
- spiorf 4y agoWhat he means is that while the models tags code as code, for the model itself this is just relationship between tokens,like the code open and close tags,same as parenthesis, commas, uppercase or verbs and conjunctions... What you say is achievable only if another system external to the model takes some tagged model output, makes computations or lookups, and feeds the results back to the model in the form of text input. Then it's game on for the model to trigger some form of code execution through this external system and escape the jail...
- lossolo 4y ago> Since it's impossible to identify such functions by simply looking at them, it'd be a great way of basically performing a DoS-attack on the model. Correct that it's impossible because you would need to solve halting problem to do it but you could set energy/time limits for query and just stop it when you reach that limit.