7 ms·

I wanted a privacy preserving AI chat bot since I didn't feel comfortable about putting personal issues into ChatGPT. It uses webllm models to run in the browse

by hmdai 3y ago

I wanted a privacy preserving AI chat bot since I didn't feel comfortable about putting personal issues into ChatGPT. It uses webllm models to run in the browser. Make your own chat by saving a message. Disclaimer: I'm the creator of https://hony.ai https://hony.ai that was used to build this demo.

jacquesm 3y ago
[flagged]
- deleted 3y ago
  [deleted]
- hmdai 3y ago
  I think I can't trust a therapist enough to be completely honest, while I can just write anything into the chat, knowing no one, (except google) will ever know :D
- mkmk3 3y ago
  Rubber ducking is worth a lot, and have the Meditations vaguely quoted back at you seems like it would help out on occasion.
- empath-nirvana 3y ago
  LLM's are surprisingly good at giving advice about minor personal problems and social situations, probably on par with a newspaper advice columnist. It's not therapy but that doesn't mean it's not useful. The main problem is it's relentlessly positive and it's not going to give you 'tough love' advice, so if you're really a mess you're not going to hear what you need to hear.
skottenborg 3y ago
Cool! Can webLLM handle inference of models with any meaningful size? Can I ask what model is used?
- hmdai 3y ago
  Thanks! It's using Llama 2 7B, It supports bigger models but those take longer to download and also infer (if run at all depending on the device)
bambax 3y ago
Ok, but how is Marcus Aurelius involved? Does it use search the Meditations with RAG, or does it use a model fine-tuned on extracts from the Meditations? Or...?
- riebschlager 3y ago
  Ah, a most excellent inquiry, my dear! adjusts philosopher's cloak As Marcus Aurelius, I must say that the connection between Marcus Aurelius and this chatbot is purely nominal.
- hmdai 3y ago
  You can make any chat you want by saving the last message, e.g. if you just need a friendly chat bot, you can create that as well.

by hmdai 3y ago

jacquesm 3y ago

[flagged]

deleted 3y ago
[deleted]
hmdai 3y ago
I think I can't trust a therapist enough to be completely honest, while I can just write anything into the chat, knowing no one, (except google) will ever know :D
mkmk3 3y ago
Rubber ducking is worth a lot, and have the Meditations vaguely quoted back at you seems like it would help out on occasion.
empath-nirvana 3y ago
LLM's are surprisingly good at giving advice about minor personal problems and social situations, probably on par with a newspaper advice columnist. It's not therapy but that doesn't mean it's not useful. The main problem is it's relentlessly positive and it's not going to give you 'tough love' advice, so if you're really a mess you're not going to hear what you need to hear.

skottenborg 3y ago

Cool! Can webLLM handle inference of models with any meaningful size? Can I ask what model is used?

hmdai 3y ago
Thanks! It's using Llama 2 7B, It supports bigger models but those take longer to download and also infer (if run at all depending on the device)

bambax 3y ago

Ok, but how is Marcus Aurelius involved? Does it use search the Meditations with RAG, or does it use a model fine-tuned on extracts from the Meditations? Or...?

riebschlager 3y ago
Ah, a most excellent inquiry, my dear! adjusts philosopher's cloak As Marcus Aurelius, I must say that the connection between Marcus Aurelius and this chatbot is purely nominal.
hmdai 3y ago
You can make any chat you want by saving the last message, e.g. if you just need a friendly chat bot, you can create that as well.