10 ms·
Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
- mkw5053 3y agoI’ve been heavily using chatgpt (gpt 4) on my honeymoon/baby moon/vacation in Spain. Everything from itineraries to asking art history questions in museums. I’ve mainly been using the voice input on my iPhone for chatgpt on a mobile browser and I can’t help but think how useful better voice support will be.
- golergka 3y agoDid you have access to plugins?
- tikkun 3y agoI've got an iPhone app in testflight beta that has speech to text and text to speech. Basically a nicer iPhone app for GPT-4, I tried most of the existing ones and none were particularly nice UX. Pricing model for now is you just pay exactly what we pay (we just pass on the API costs plus Apple's 30%, no markup). We could add a use your own API key thing too to avoid Apple's 30%. If you'd like access, email in profile
- umaar 3y agoMade something similar recently, but for WhatsApp: https://chatbling.net/ https://chatbling.net/ What behaviour would users prefer when uploading a voice message, a) the voice message is transcribed, so speech to text? Or b) the voice message is treated as a query, so you receive a text answer to your voice query? I've done a) for now as mobile devices already let you type with your voice.
- umaar 3y agoI see my server has restarted a few times! I imagine it's folks here since I haven't shared Chat Bling elsewhere yet. Sorry to anyone who started generating images, but haven't received a response. The 'jobs' for images generations are stored entirely within memory, so a server restart will lose all of that. Going forward, I'll explore storing image jobs in redis or something, which will be more resilient to server crashes. As for conversation history, I'll continue to keep that in memory for now (messages are evicted after a short time period, or if messages consume too many OpenAI tokens) - even that's lost during a server restart/crash. Feels like quite a big decision to store sensitive chat history in a persistent database, from a privacy standpoint.
- swores 3y agoYou could have a default "will be wiped after <x time>" policy / notification up front, plus an option to change this (in either direction, one way to "only store this in RAM not the DB, and wipe it as soon as I close this window - or maybe after an hour of inactivity", the other way to "please never delete (we reserve the right to delete anyway but will keep for at least Y days/months/whatever)". And also a "delete now" button to override. And then a cron job checking what's due to be deleted and wiping them from the DB/memory? Of course, it maybe also adds more pressure to keep the server more secure without private conversations being accessible after a reboot...
- umaar 3y agoAgreed, giving the user a choice would be best here. Something tells me most users would not change it from whatever the default is, but yeah still good to expose this as a setting which should be doable. Thanks for the input!
- swores 3y agoNp - and you're probably right that I'm in the minority of people who'd care about having as much granular control as possible... maybe most people would rather something closer to a browser's privacy mode, so just a toggle on and off between very private and don't care about private?
- aftergibson 3y agoI'm guessing on step 3, the meant touch .env, not mkdir. mkdir .env and fill the following: TELEGRAM_TOKEN= OPENAI_API_KEY= PLAY_HT_SECRET_KEY= PLAY_HT_USER_ID=
- hankman86 3y agoIt amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of lawsuits on the grounds of LLMs being structurally incompatible with notorious privacy laws like the GDPR. For instance, how would they implement the GDPR’s “right to be forgotten”? Untrain the model?
- elif 3y agofor commercial snoops you have very strong legal protections over your data if you seek to enforce it legally. for government snoops you don't have any privacy anyway.
- avereveard 3y agoon one hand yes there is a real threat of these company misusing personal data, espèecially if you use the public side of the API (i.e. not the one from within azure, which has a separate set of privacy guarantees as far as I can understand) on the other hand this is a guardrail like the many others that GPT already has, if I search my name I get a 'not notable enough' answer already
- weikju 3y agoAs my friends would say "all my data is out there already, so it doesn't matter anymore"... this is what we're dealing with here.
- Cyphase 3y ago(I may have misunderstood your comment to some extent, but I'm going to send this reply anyway even if just to clarify for anyone else who might misunderstand.) --- I agree with "be careful what you send to the chat bot", but let's clarify some things in case you or someone else reading your comment is misunderstanding. LLMs aren't immature AI brains that "may even permanently ingest user data for training purposes". They're just models, which are represented by an architecture described in readable source code, and weights derived from training. There is a very clear delineation between inference and training. Models are static when being used for inference. You don't need to "untrain" the model after you ask it something; you never trained it in the first place. Running inference does not change the trained weights. If you're talking about OpenAI specifically saving ChatGPT data for later training purposes, they absolutely are doing that; they aren't hiding it. But that's a purposeful "let's take this data and use it for training", not "oh no, our immature tech accidentally ingested prompt data, how do we untrain it"?
- rapsey 3y agoAre there any offline text to speech options that supports a wide variety of languages?
- andag 3y agoCan you update the readme with some info privacy wise. Some info on who I'm sharing my data with? Openai - fair enough, already doing that a fair amount .
- pantulis 3y agoIt seems that you can self host the thing. Apart from that, it seems that you would be sharing info obviously with OpenAI (both GPT and Whisper), Telegram and Google.
- floitsch 3y agoDid something similar (without voice) that runs on an esp32. This way I don't need any server or keep my desktop machine running. Supports Telegram and Discord. https://github.com/floitsch/ai-projects/tree/main/chat https://github.com/floitsch/ai-projects/tree/main/chat
- sheepscreek 3y agoOP integrated LangChan and the ability to Google results (and a neat way to integrate more agents). That’s the main draw for me in their implementation.
- floitsch 3y agoYeah... That would be hard to do in the limited memory of the ESP32. Main issue is the cost of TLS connections.
- 55555 3y agoI want something like this but I don't want to have to host it myself. Is there any I can simply sign up to?
- marc 3y agoI made https://t.me/marcbot https://t.me/marcbot a few weeks ago. Comes with voice memo support, etc.
- voicedYoda 3y agoPage crashed?
- Hadriel 3y agoit's not working :(
- sheepscreek 3y agoGreat work! Thanks for taking the time to build this and open sourcing it. For me, it scratches on a very real itch. I’ve toyed with the idea of a personal AI assistant to act as a second brain, and help me prioritize and remember things with human intuition (“you can’t afford to delay X, do X today and maybe reach out to Z to set the expectations for delaying Y?”). To me, the greatest strength of LLMs is not their knowledge (which is prone to hallucination), but their ability to analyze ambiguous requests with ease and develop a sane action plan - much like a competent human. One a side note: wouldn’t it be significantly cheaper and as effective to use ChatGPT 3.5 by default, and reserve GPT 4 for special tasks with explicit instruction (“Use GPT 4 to…”). For most chats, GPT 4 would be incredibly wasteful (read: expensive). Also - it would be very cool to experiment the use of GPT 3.5 and GPT 4 in the same conversation! GPT 3.5 could leverage the analysis of GPT 4 and act as the primary communication “chatbot” interface for addressing incremental requests.
- ratg13 3y ago>a personal AI assistant to act as a second brain, and help me prioritize and remember things with human intuition Everyone wants this, but this is not the product. The current AI offerings are information in --> information out. It is not meant to keep state long term, and it is not meant to be your friend. It is meant to answer questions with the information available to it. You can even see in the example screenshot they showcase the fact that it is not designed to be asked follow-up questions.
- JanSt 3y agoYou can use Langchain / Plugins to get around that issue
- hn_throwaway_99 3y agoThat's just the case for this bot, but is obviously not the case for ChatGPT. I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and outputs my current outstanding task list. I've been using this for weeks now, and since it's all in a single conversation ChatGPT can keep track of the entire state over time. I don't have access to plugins yet but it would be trivial to implement a personal AI assistant with ChatGPT if it could, for example, look up flight times and prices.
- yosito 3y agoGreat, so instead of sharing all your data with one party, you can share it with 3+ parties
- MH15 3y agoThis is being downvoted but it's an important thing to consider. As we move to doing more with these systems we're going to start seeing restrictions on which AI tools we can use at work/school/home.
- aivisol 3y agoNice work. I have a question though. The example chat window you show has an interaction where AI explains that it cannot remember the previous question. Isn’t Langchain there for exact that purpose or am I missing something?
- marc 3y agoFor people who are looking for a hosted solution: https://t.me/marcbot https://t.me/marcbot Being able to use voice messages as an interface makes a huge difference. I can just ramble on, sharing my thoughts, and then have GPT turn it into something sensible. Great for brainstorming, getting your thoughts out on "paper", etc.
- hombre_fatal 3y agoThis is the new hello world. https://github.com/danneu/telegram-chatgpt-bot https://github.com/danneu/telegram-chatgpt-bot https://t.me/god_in_a_bot https://t.me/god_in_a_bot (demo bot) I tried building this for WhatsApp but Twilio is weirdly expensive. I don't even think Twilio is cheap for sending 2FA tokens.
- moralestapia 3y agoI'm also on Twilio and yes it is expensive, a longish call (10 mins) comes to about $1. They charge you for: * Time spent using the "Twilio Client" (whatever that means) * Inbound call time * Transcription of each audio chunk, billing them at a minimum of 15s per function call * Every time you use their text-to-speech functions (not even that is free)
- aqme28 3y agoIt is expensive, so I made a version for myself as a Discord bot https://github.com/alexQueue/GPTBotHost/ https://github.com/alexQueue/GPTBotHost/ (note: code is sketchy. Not really cleaned up for the public)
- hombre_fatal 3y ago> note: code is sketchy. Not really cleaned up for the public No worries, you're in good company.
- jcims 3y agoDoes anyone have a suggestion for doing something similar with SMS? I've been tinkering with it but it seems that there are some regulations that will require me to have a commercial organization registered to allow SMS to 10 digit North America numbers.
- christiangenco 3y agoI don't think you need a commercial organization registered to get a number on Twilio. I hooked up an old Twilio number I bought a while ago to ChatGPT for an ADHD encouragement bot last week: https://attaboy.ai https://attaboy.ai Now I can message it via. WhatsApp or Telegram and it even remembers chat history (by storing the last ~20 messages in Firebase).
- jcims 3y agoNice! I'm using twilio as well, will try to power through it.
- MetaWhirledPeas 3y agoNot as cool, but there for the lazy: install the Bing app on your phone (I guess you need to be accepted into the beta first?). I use it as a slow-thinking alternative to Google Assistant that usually gives much better answers.
- throwaway2203 3y agoThe Bing app isn't as responsive as ChatGPT. I asked it a slightly question about my taxes and it "binged" something weird and gave me a non-answer generic response.
- titaniczero 3y agoI’ve noticed that bing chat is better if you instruct it not to search anything, that way it will use the model knowledge. I’ve learned to use the model knowledge or the web search results summary depending on what I want. But ChatGPT is still way better for model knowledge because it has fewer restrictions. I wish they would make this distinction clearer in the UI. Most of the time it can answer without resorting to search, I think it would be better if the user explicitly specifies that they need web results.
- MetaWhirledPeas 3y agoIt definitely has a web search bias, no surprise, but that's kind of its superpower too. It lacks the snappy responses that Assistant can give, especially with routine questions like the weather.
- Fauntleroy 3y agoUsing a cloud-hosted AI with a Terms-of-Service as an assistant is a recipe for disaster in the future. I can't wait for the future where everyone is reliant on a corporate spy for everything they do.
- yewenjie 3y agoPlay.ht's API is like $99/month. Is it possible to use any other TTS service? (Also, does play.ht just use Azure underneath?)
- mwlp 3y agoI added gpt to a bot of mine for Telegram and Discord a few weeks ago. I'm constantly amazed at how the littlest of things can spawn so many new opportunities for inside jokes and meta humor.
- Heloseaa 3y agoRecently did the same in a lightweight alternative with python: https://github.com/clemsau/telegram-gpt https://github.com/clemsau/telegram-gpt Looking to make it accessible, cheap and as lean as possible. I'd love to hear potential features ideas.
- soederpop 3y agoi was able to do something similar with Siri using the shortcuts app. You can have siri transcribe your text and post it to an endpoint and then read the response back to you. is it possible to use gpt-4 with langchain?