3 ms·
Tested it out a bit yesterday: it does work as advertised, and notably does work with image input: https://twitter.com/minimaxir/status/1776248424708612420 http
by minimaxir 3y ago
Tested it out a bit yesterday: it does work as advertised, and notably does work with image input: https://twitter.com/minimaxir/status/1776248424708612420 https://twitter.com/minimaxir/status/1776248424708612420
However, there is a rather concerning issue that even with a tool specified, the model tends to be polite and reply with "Here's the JSON you asked: <JSON>" which is objectively not what I want and aggressive prompt engineering to stop it from doing that has a lower success rate than I would like.
- syoc 3y agoThe mana cost is wrong on 3 out of 4 cards, no?
- minimaxir 3y agoI never claimed it was robust (I made this project in an hour after a beer), just that it worked. Mana costs both on the card and on the rules text (e.g. Ward 2 should be Ward {2}) seem to be an issue and I'm curious as to why. I may have to experiment more with few-shot examples.
- morkalork 3y agoTwo things help with this: add an assistant prompt that is just "{", and put "}" in the stop sequence.
- iAkashPaul 3y agoTGI+grammar loaded with Mistral/Mixtral works great for structured output now! No more langchain exception handling for unmatched Pydantic definitions.