7 ms·
Offline Chat with Marcus Aurelius
- hmdai 3y agoI wanted a privacy preserving AI chat bot since I didn't feel comfortable about putting personal issues into ChatGPT. It uses webllm models to run in the browser. Make your own chat by saving a message. Disclaimer: I'm the creator of https://hony.ai https://hony.ai that was used to build this demo.
- jacquesm 3y ago[flagged]
- deleted 3y ago[deleted]
- hmdai 3y agoI think I can't trust a therapist enough to be completely honest, while I can just write anything into the chat, knowing no one, (except google) will ever know :D
- mkmk3 3y agoRubber ducking is worth a lot, and have the Meditations vaguely quoted back at you seems like it would help out on occasion.
- empath-nirvana 3y agoLLM's are surprisingly good at giving advice about minor personal problems and social situations, probably on par with a newspaper advice columnist. It's not therapy but that doesn't mean it's not useful. The main problem is it's relentlessly positive and it's not going to give you 'tough love' advice, so if you're really a mess you're not going to hear what you need to hear.
- skottenborg 3y agoCool! Can webLLM handle inference of models with any meaningful size? Can I ask what model is used?
- hmdai 3y agoThanks! It's using Llama 2 7B, It supports bigger models but those take longer to download and also infer (if run at all depending on the device)
- bambax 3y agoOk, but how is Marcus Aurelius involved? Does it use search the Meditations with RAG, or does it use a model fine-tuned on extracts from the Meditations? Or...?
- riebschlager 3y agoAh, a most excellent inquiry, my dear! adjusts philosopher's cloak As Marcus Aurelius, I must say that the connection between Marcus Aurelius and this chatbot is purely nominal.
- hmdai 3y agoYou can make any chat you want by saving the last message, e.g. if you just need a friendly chat bot, you can create that as well.
- csours 3y agoSci-Fi has a lot of 'brain in a box' stories - a personal consciousness is preserved in a computer, stasis box, etc etc. It feels like we're almost at the point where we can simulate a brain in a box to an external observer, but without preserving consciousness. I wonder if you would want to be preserved this way? As a kind of zombie intelligence.
- paxys 3y agoEnough to fool an observer, sure, but it isn't really replicating the "brain", just predicting and mimicking someone's speech and writing patterns. We have no special insight into the original individual other than historical records. We don't know how their neurons were wired. We can't come even close to predicting how they would have behaved in real life scenarios that first came about thousands of years after their death.
- jerf 3y agoYou can put enough meat on this observation that it can stand up even to radical "yeah but what is consciousness anyhow" skeptics. While I may not be able to put a solid minimum floor on the complexity of a human consciousness in terms of its information theoretic content, I think we can be quite confident that it exceeds the information-theoretic content of what history tells us about Marcus Aurelius, all several-hundred-kilobytes-tops we have. And that's honestly a generous assessment of the amount of info we have in a true information-theoretic sense. There is certainly no way to recover Marcus Aurelius just from his writing no matter how much fancy AI is thrown at it; it is simply mathematically impossible.
- addaon 3y ago> There is certainly no way to recover Marcus Aurelius just from his writing no matter how much fancy AI is thrown at it; it is simply mathematically impossible. Without addressing whether I agree with your conclusion or not, I disagree that this is a rigorous argument. The question isn't how much complexity the text processing machine that was the Original Marcus has, it's how much of that complexity was unique to OM. We have a large amount of information about modern humans, and a good chunk about historical humans. You would need to believe not just that OM requires many times more information than the hundreds of kilobytes we have, but that the OM delta patch to standard human or period-adjusted human /also/ has more information that the hundreds of kilobytes we have. I'm not sure it's obvious that humans are that interesting or that different, even interesting humans.
- mkmk3 3y agoGood to note it uses webgpu, so no mobile, and only nightly firefox. Sounds like a cool idea though, I'll check it out at some point.
- deadlydose 3y ago> Error: Cannot find WebGPU in the environment - Updating your browser might resolve the issue! Using Firefox ESR 115 under Debian (testing). dom.webgpu.enabled is false by default. Enabling it results in: > NotSupportedError: WebGPU is not yet available in Release or Beta builds. - Updating your browser might resolve the issue! May I ask why it's required?
- hmdai 3y agoThe underlying model is created for webgpu, not to mention the feasibility of running LLM with webgpu, read more here: https://webllm.mlc.ai/ https://webllm.mlc.ai/
- aydyn 3y agoTo mine crypto ofc. Why do you think?
- hmdai 3y agoRead more about why webgpu is required here: https://webllm.mlc.ai/ https://webllm.mlc.ai/ (that's the project that is used here)
- lousken 3y agodoesn't work for me in firefox 122 (for windows w/ webgpu enabled in config) as well
- automatoney 3y agoI haven't read any Marucs Aurelius, so my impression might be off, but the way the AI speaks feels... I don't know, like a British person, or some American from an older time? It keeps saying "my dear" which feels very incorrect. I studied Latin in school, so maybe I'm more used to the translationese and odd grammar you see with that (like here - although this is also an older translation so you get some of that older english vibe https://www.gutenberg.org/cache/epub/2680/pg2680-images.html https://www.gutenberg.org/cache/epub/2680/pg2680-images.html) I'm guessing this was trained on a certain translation of his works, but I think part of the fun of speaking to a bot would be to replicate that sort of language barrier feeling.
- perihelions 3y ago(For context: that translation is a 1634 one by Méric Casaubon, with an introduction written in 1900 by W. H. D. Rouse. Seems Project Gutenberg is missing this authorship information, or lost a title page somewhere). https://en.wikisource.org/wiki/Marcus_Aurelius_Antoninus_-_His_Meditations_concerning_himselfe https://en.wikisource.org/wiki/Marcus_Aurelius_Antoninus_-_H...
- PreInternet01 3y agoDoesn't work in Firefox-on-Windows, but does give results in Edge. Less than impressive results, mind you, but results nonetheless... AI-Garbage: As Marcus Aurelius, I must say that... <snip> Me: Ehm, why do you speak modern-ish English? Aren't you supposed to be ancient Greek or Roman, or whatever? AI-Garbage: Ah, a most excellent question, my dear <snip> I find that the ancient tongues of Greek and Latin are most excellent <snip> I must admit that I find the modern languages of today to be most useful for, well, communicating with the people of today! <snip> Me: Ah les langues modernes, je les aime aussi! Mais pourquoi insistes-tu pour m’appeler "chéri"? Cela ressemble à un interrogatoire garanti par les RH, non? AI-Garbage: Ah, bonjour there, young linguist! <snip> I must apologize for any confusion regarding the term "chéri." <snip> Please, my dear, do feel free to address me in any manner that you see fit <snip> Me: Richtig! Aber was jetzt, Schwanzgesicht? AI-garbage: — Ah, I see! <snip> I must inform you that this term is not a word that I am familiar with <snip> I am always here to assist you in any way possible, while always being mindful of your comfort and consent. Ah, okay, so it does seem to be familiar with the term after all! In any case, I don't think this is a particularly, eh, convincing demonstration of AI will take all of our jobs in the next decade, but anyway...
- nurgasemetey 3y agoKernel task kicks, totally freezing my laptop.
- leeeeeepw 3y ago[dead]
- leeeeeepw 3y agoSorry this is coming up as flagged for some reason, hn getting really bad for censorship