3 ms·
This is cool! One thing that can be easily improved is that the narrator is still trying to describe everything, while people using Be My Eyes they usually got
by enoch2090 3y ago
This is cool! One thing that can be easily improved is that the narrator is still trying to describe everything, while people using Be My Eyes they usually got specific purposes (or "attention"). Would be nice to also implement whisper.cpp and use query inputs with some CoT or prompting to refine the description.
- lxe 3y agoThis is an awesome idea! Yeah refining and asking more questions about the image could make it viable. The BakLlava model is pretty impressive, but I do need to tune the prompts and the hyperparams as well. Or even do a small finetune. It’s a fun space to dive into.
- umtksa 3y agoawesome, love the idea and maybe putting a default prompt like: "this images comes from the persons POV that ask you questions" instead of "a person holding something" "you are holding xyz" wold be better