lbeurerkellner

9 ms·

91.
by lbeurerkellner 3y ago
For a showcase of different LMQL queries and resulting model output, have a look at https://lmql.ai . Per query, the LMQL runtime calls the underlying LM several times, to execute the complete specified (multi-part) query program
92.
by lbeurerkellner 3y ago
If I understand correctly what you are imagining is some sort of local retrieval enhancement to generate a specific part of the overall response, which later is removed, once e.g. the generated piece of code (e.g. a function call) has compl
93.
by lbeurerkellner 3y ago
Author here, thanks for posting us. Be sure to play around with our entirely web-based playground IDE here: https://lmql.ai/playground and our example showcase at https://lmql.ai . We are happy to answer any ques
94.
by lbeurerkellner 3y ago
Author here. LMQL gives you a concise way to define multi-part prompts and enforce constraint on LLMs. For instance, you can make sure the model always adheres to a specific output format, where parsing of the output is automatically taken
95.
by lbeurerkellner 3y ago
We are building a programming language ( https://lmql.ai ), that allows you to execute programs with control-flow and constrained behavior on top of LLMs. Essentially imperative LLM text generation.
96.
by lbeurerkellner 3y ago
LMQL dev here :) Can you specify what you mean "constrains its utility". Are you looking to use LMQL from different languages? We are currently thinking about expanding to other ecosystems, so it would be interesting hear your tho
97.
by lbeurerkellner 4y ago
I think prompting will definitely evolve more towards a PL than informal natural language, as informal text will always be inherently imprecise.
98.
by lbeurerkellner 4y ago
I don't fully buy into this idea. In the end there is an inherent bottleneck when it comes to the expressiveness of natural language. To do something correctly, you need some sort of precise description of what it is that you are tryin
99.
by lbeurerkellner 4y ago
Definitely. I see this going even further, probably leading to something akin to programming, i.e. interleaving multiple prompts, one prompt calling another, like lmql or langchain.
100.
by lbeurerkellner 4y ago
(Another LMQL author here) Cost is definitely a dimension we are considering (research has limited funding after all :) ), especially with the OpenAI API. Lock-step token-level control is difficult to implement with the very limited OpenAI
101.
by lbeurerkellner 4y ago
LMQL author here, thanks for commenting. prlang looks really cool, I will have a closer look. LLMs+PLs is a very interesting field right now, lots of directions to explore. LMQL`s efficiency gains can be attributed to close supervision of t