5 ms·

I'm pretty interested in this as well. I have moved from Notion to Obsidian for my personal notes, to-do lists and errata in preparation for this since obsidian

I'm pretty interested in this as well. I have moved from Notion to Obsidian for my personal notes, to-do lists and errata in preparation for this since obsidian uses local plaintext files. What I would love to get working at some point is allowing an LLM access to my schedule, notes and goals and then have it help prompt me at appropriate times. "Hey, TJ I noticed you haven't worked out this week, it's sunny today this might be a good time". That sort of thing. There seem to be good tooling around agents, prompt engineering, RAG etc. The 'glue' around getting the LLM to help figure out when appropriate time(s) to check in with me is the bit I am missing, but that's probably mostly down to me being an artist and only a very very JR hobbyist programmer though.

kolinko 3y ago
I’m working on this right now, will be open sourcing soon probably :)
- TrevorJ 3y ago
  That's pretty cool - let us know if you do!
willsmith72 3y ago
I've been thinking about the 'glue' bit too. I think a cron job run say every hour would be good enough. It would just have to collect all the inputs and make a decision about how "valuable" it would be to check in (haven't worked out in 3 days, very valuable), then it's just about connecting it to the right outputs (email, push noti, ...) The job itself would be cheap and trivial to host on something like lambda
sureglymop 3y ago
Just be aware of the security implications. Maybe it's unrealistic but what if someone sends you a calendar invite containing a prompt injection? It may not seem like a big issue but at worst (e.g. with github copilot) something like this may lead to remote code execution.
- TrevorJ 3y ago
  Yeah, it's a good point. Have a feeling we will see a lot of sneaky security issues around LLM's over the next few years to say the least.
Casteil 3y ago
Having come from Notion also, I LOVE Obsidian for its non-proprietary markdown file structure. Incredible powerful plugins, too. FWIW, it's not really what you're seeking... but there is a plugin that allows you to invoke an LLM from within Obsidian (via Ollama): https://github.com/hinterdupfinger/obsidian-ollama https://github.com/hinterdupfinger/obsidian-ollama In short, it allows you to set up prompts to act on selected text directly within a file, e.g. 'Summarize this selection as a markdown formatted list of key points', 'Write a PRD', 'Translate to [Language]', 'Run this as a prompt', etc.
- TrevorJ 3y ago
  That's a pretty slick plugin I will have to check it out, thanks for the suggestion.
unoti 3y ago
> What I would love to get working at some point is allowing an LLM access to my schedule, notes and goals and then have it help prompt me at appropriate times. "Hey, TJ I noticed you haven't worked out this week, it's sunny today this might be a good time". That sort of thing. If you work in a Microsoft world, this is what GraphAPI is all about: enabling access to all the things using your personal authentication token. This includes emails, calendar, OneNote, One Drive, and essentially everything. I've been working on making an easy to use OneNote provider with GraphAPI underneath it that I can use to work with the LLM. https://learn.microsoft.com/en-us/graph/overview https://learn.microsoft.com/en-us/graph/overview https://learn.microsoft.com/en-us/graph/use-the-api https://learn.microsoft.com/en-us/graph/use-the-api
- TrevorJ 3y ago
  interesting, thank you.
pcdoodle 3y ago
I like it.

kolinko 3y ago

I’m working on this right now, will be open sourcing soon probably :)

TrevorJ 3y ago
That's pretty cool - let us know if you do!

willsmith72 3y ago

I've been thinking about the 'glue' bit too. I think a cron job run say every hour would be good enough. It would just have to collect all the inputs and make a decision about how "valuable" it would be to check in (haven't worked out in 3 days, very valuable), then it's just about connecting it to the right outputs (email, push noti, ...) The job itself would be cheap and trivial to host on something like lambda

sureglymop 3y ago

Just be aware of the security implications. Maybe it's unrealistic but what if someone sends you a calendar invite containing a prompt injection? It may not seem like a big issue but at worst (e.g. with github copilot) something like this may lead to remote code execution.

TrevorJ 3y ago
Yeah, it's a good point. Have a feeling we will see a lot of sneaky security issues around LLM's over the next few years to say the least.

Casteil 3y ago

Having come from Notion also, I LOVE Obsidian for its non-proprietary markdown file structure. Incredible powerful plugins, too. FWIW, it's not really what you're seeking... but there is a plugin that allows you to invoke an LLM from within Obsidian (via Ollama): https://github.com/hinterdupfinger/obsidian-ollama https://github.com/hinterdupfinger/obsidian-ollama In short, it allows you to set up prompts to act on selected text directly within a file, e.g. 'Summarize this selection as a markdown formatted list of key points', 'Write a PRD', 'Translate to [Language]', 'Run this as a prompt', etc.

TrevorJ 3y ago
That's a pretty slick plugin I will have to check it out, thanks for the suggestion.

unoti 3y ago

> What I would love to get working at some point is allowing an LLM access to my schedule, notes and goals and then have it help prompt me at appropriate times. "Hey, TJ I noticed you haven't worked out this week, it's sunny today this might be a good time". That sort of thing. If you work in a Microsoft world, this is what GraphAPI is all about: enabling access to all the things using your personal authentication token. This includes emails, calendar, OneNote, One Drive, and essentially everything. I've been working on making an easy to use OneNote provider with GraphAPI underneath it that I can use to work with the LLM. https://learn.microsoft.com/en-us/graph/overview https://learn.microsoft.com/en-us/graph/overview https://learn.microsoft.com/en-us/graph/use-the-api https://learn.microsoft.com/en-us/graph/use-the-api

TrevorJ 3y ago
interesting, thank you.

pcdoodle 3y ago

I like it.