3 ms·

> The goal is to build a language and system model that allows us to reliably sandbox and support agents in constructing "Trustworthy-by-Construction AI Agents.

> The goal is to build a language and system model that allows us to reliably sandbox and support agents in constructing "Trustworthy-by-Construction AI Agents." 1 - Reliability implies predictable behavior. 2 - Predictable behavior implies determinism. 3 - LLM's are non-deterministic algorithms. In the link you kindly provided are phrases such as, "increases the likelihood of successful correct use" and "structure for the underlying LLM to key on", yet earlier state: In this world merely saying that a system is likely to behave correctly is not sufficient. Also, when describing "a suitable action language and specification system", what is detailed is largely, if not completely, available in RAML[0]. Are there API specification capabilities Bosque supports which RAML[0] does not? Probably, I don't know as I have no desire to adopt a proprietary language over a well-defined one supported by multiple languages and/or tools. 0 - https://github.com/raml-org/raml-spec/blob/master/versions/raml-10/raml-10.md/ https://github.com/raml-org/raml-spec/blob/master/versions/r...

adrianN 1y ago
Reliability does not require determinism. If my system had good behavior on inputs 1-6 and bad behavior on inputs 7-10 it is perfectly reliable when I use a dice to choose the next input. Randomness does not imply complete unpredictability if you know something about the distribution you’re sampling.
mrkmarron 1y ago
The key capability that Bosque has for API specs is the ability to provide pre/post conditions with arbitrary expressions. This is particularly useful once you can do temporal conditions involving other API calls (as discussed in the blog post and part of the 2.0 push). Bosque also has a number of other niceties[0] -- like ReDOS free pattern regex checking, newtype support for primitives, support for more primitives than JSON (RAML) such as Char vs. Unicode strings, UUIDs, and ensures unambiguous (parsable) representations. Also the spec and implementation are very much not proprietary. Everything is MIT licensed and is being developed in the open by our group at the U. of Kentucky. [0] https://dl.acm.org/doi/pdf/10.1145/3689492.3690054 https://dl.acm.org/doi/pdf/10.1145/3689492.3690054

adrianN 1y ago

Reliability does not require determinism. If my system had good behavior on inputs 1-6 and bad behavior on inputs 7-10 it is perfectly reliable when I use a dice to choose the next input. Randomness does not imply complete unpredictability if you know something about the distribution you’re sampling.

mrkmarron 1y ago

The key capability that Bosque has for API specs is the ability to provide pre/post conditions with arbitrary expressions. This is particularly useful once you can do temporal conditions involving other API calls (as discussed in the blog post and part of the 2.0 push). Bosque also has a number of other niceties[0] -- like ReDOS free pattern regex checking, newtype support for primitives, support for more primitives than JSON (RAML) such as Char vs. Unicode strings, UUIDs, and ensures unambiguous (parsable) representations. Also the spec and implementation are very much not proprietary. Everything is MIT licensed and is being developed in the open by our group at the U. of Kentucky. [0] https://dl.acm.org/doi/pdf/10.1145/3689492.3690054 https://dl.acm.org/doi/pdf/10.1145/3689492.3690054