4 ms·

This is a really cool effect. How do you envision this being used? Thinking about it as a product, I’d want a way to easily slip in and out of “LLM please resp

This is a really cool effect. How do you envision this being used? Thinking about it as a product, I’d want a way to easily slip in and out of “LLM please respond” so it wasn’t constantly trying to write back the moment I stopped the stylus - maybe I’d want awhile to sketch and think, then restart a conversation. Or maybe for certain pages to be LLM-enabled, and others not. Does it require any sort of jailbreak to get SSH access to the device?

awwaiid 2y ago
The reMarkable comes with root-ssh out of the box, so installation here is scp'ing a rust-built binary over, and then ssh'ing and running it. I haven't wrapped it in a startup-on-boot service yet. It is triggered right now by finger-tapping in the upper-right corner, so you can ask it to respond to the current contents of the screen on-demand. I think it would be cool to have another out-of-band communication, like voice, but this device has no microphone. Also right now it is one-shot, but on my long long TODO list is a second trigger that would _continue_ a back and forth multi-screenshot (like multi-page even) conversation.
- rybosome 2y ago
  Ah great, I will definitely give this a try later then, thanks! I’m curious if this is becoming something that you are using in your own day-to-day, or if your focus right now is on building it? The context for my question is just a general interest in the transition to AI-enabled workflows. I know that I could be much more productive if I figured out how to integrate AI assistance into my workflows better.
  - awwaiid 2y ago
    Only building so far. The one use-case that is _close_ to ready-for-useful: I often take business meeting notes. In these notes I often write a T in a circle to indicate a TODO item. I am going to add a bit of config in there, basically "If you see a circle-T, then go add that to my todo list if it isn't already there. If you see a crossed-out circle-T then go mark it as done on the todo list" . I got slightly distracted implementing this, working instead toward a pluggable "if you see X call X.sh" interface. Almost there though :)

awwaiid 2y ago

The reMarkable comes with root-ssh out of the box, so installation here is scp'ing a rust-built binary over, and then ssh'ing and running it. I haven't wrapped it in a startup-on-boot service yet. It is triggered right now by finger-tapping in the upper-right corner, so you can ask it to respond to the current contents of the screen on-demand. I think it would be cool to have another out-of-band communication, like voice, but this device has no microphone. Also right now it is one-shot, but on my long long TODO list is a second trigger that would _continue_ a back and forth multi-screenshot (like multi-page even) conversation.

rybosome 2y ago
Ah great, I will definitely give this a try later then, thanks! I’m curious if this is becoming something that you are using in your own day-to-day, or if your focus right now is on building it? The context for my question is just a general interest in the transition to AI-enabled workflows. I know that I could be much more productive if I figured out how to integrate AI assistance into my workflows better.
- awwaiid 2y ago
  Only building so far. The one use-case that is _close_ to ready-for-useful: I often take business meeting notes. In these notes I often write a T in a circle to indicate a TODO item. I am going to add a bit of config in there, basically "If you see a circle-T, then go add that to my todo list if it isn't already there. If you see a crossed-out circle-T then go mark it as done on the todo list" . I got slightly distracted implementing this, working instead toward a pluggable "if you see X call X.sh" interface. Almost there though :)