16 ms·
Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack
- Vasyl_R 4y agoHey Everybody! We are super stoked to announce present you IngestAI today. It is the fastest way to build contextually intelligent ChatGPT-like bots within your own WhatsApp, Slack, or Discord to answer queries from your knowledge base, documentation, or educational materials. IngestAI is a very useful tool for a diverse range of businesses that have company knowledge base or customer support. IngestAI can save their money, providing precise and relevant answers about your product 24/7. You can upload your technical documentation as well as information from previously resolved support tickets, educational program content, ecommerce products description or any other information relevant to your business case. Key Features: 1. Flexibility: IngestAI have different file formats supported for uploading, like txt, MS Word, PDF, Excel, and many come to come very soon. 2. Other types of uploading that IngestAI currently support is URL links and integration with Notion and Confluence comes in March’23. 3. Built for global community: Integration with Sack, Discord, Telegram; 2/24 release: WhatsApp; 2/25 release: API (means integration with Shopify, Etsy, Magento, etc or even integrate with your custom CRM/ERP); March’23 release: MS Teams and Facebook Messenger. 4. AI first: IngestAI is harnessing the power of OpenAI to provide precise AI-generated answers relevant to the uploaded context 5. Customizable: go beyond simple queries using IngestAI prompt templates – use ones we have pre-made, edit any of them to your needs, or create a new from scratch. For enterprise clients willing to use IngestAI with sensitive information we offer possibility to store all the information locally on-site or own AWS S3 Cloud Storage. Please join our community: Discord : https://discord.gg/kMpbueJMtQ https://discord.gg/kMpbueJMtQ Twitter : https://twitter.com/ingestaiio https://twitter.com/ingestaiio Docs: https://ingestai.io/docs https://ingestai.io/docs We would be happy to hear your feedback. Hope you love it! Team IngestAI
- quadcore 4y agoReally nice, congrats on the launch. I wonder how safe are my confidential information with your thing?
- Vasyl_R 4y agoWe use AWS for both servers and storage.. How secure would you call AWS ?
- JustBreath 4y agoDepends on the application being hosted. Also: https://firewalltimes.com/amazon-web-services-data-breach-timeline/ https://firewalltimes.com/amazon-web-services-data-breach-ti...
- quadcore 4y agoIs my slack stored in plain text on your AWS server?
- Vasyl_R 4y agowe don't store conversations at all for the moment. I mentioned that in previous comments too. That's something some people ask, but we don't have 'conversation memory' for the moment))
- therusskiy 4y agoWould be cool to know some technical details, like are you fine-tuning GPT-3 on Open AI or built something yourself on top of an open source pretrained model?
- JustBreath 4y agoAnyone care to recommend some open source options? I've read about GPT-J, GPT-NEO, Bloom. Understanding they aren't as effective/intuitive as Open AI's stuff but unlike OpenAI, they are actually open.
- Vasyl_R 4y agoThat is a good point that you have brought up. We plan to be agnostic of underlying LLMs as ecosystem matures.
- Vasyl_R 4y agoHey there, you're welcome to our Discord server: https://discord.gg/kMpbueJMtQ https://discord.gg/kMpbueJMtQ - we do share some technical details there and we also share our daily progress in our #updates channel. Have you heard of LangChain ?
- therusskiy 4y agoFirst time I hear about it, but just checked it out - seems pretty cool, but you still need to feed some model into it right? Many examples seem to use OpenAI. I see a bunch of apps using LLMs popping out like mushrooms in a forest, but how do you fine-tune it for your dataset? The biggest (GPT-3 davinci) model on OpenAI is not available for fine-tuning.
- Vasyl_R 4y agothanks! We tried to do is as simple as possible from the users perspective. You just upload your knowledge base, create a Slack / Discord or other bot and start using it. And sure, we use OpenAI too. Yes, your're right - we use Davince model and then use use LangChain and other approaches that we're exploring to compare performance of different approaches. Have you heard about LangChain?
- nilayj 4y agoAre you using Private channels and 1:1 chats as training data?
- werds 4y agoprompt: "what do my employees really think about me?"
- Vasyl_R 4y agothat would be a good one :)) That's why we don't add chat memory for the moment :)))
- Vasyl_R 4y agothant's somehting I mentionned in some of my previous answers- this can have both positive and negative impact on the contextual intelligence of your bot, so we're now playing around with that and trying to see if that doesn't have any negative impact on the context-awareness. Do you believe chat-memory incorporation into the context it's something people would need?
- Vasyl_R 4y agohey, we are not learning from slack history. The Slack bot takes your knowledge base as the input (markdown, docs etc) and answers the queries asked by the user.
- deleted 4y ago[deleted]
- boredumb 4y agoVery cool! I was recently looking at dumping our slack data and fine tuning some openai model to do something very similar at a place I work with currently. Were there any pain points in fine tuning you wish you knew before you built everything?
- Vasyl_R 4y agoThanks for your feedback! With IngestAI you can make a Discord or Slack bot within minutes, with no-code. And if you would face any technical issue - please let us know on our Discord or by e-mail and will be happy to assist you. We go two paths - finetuning and working with embeddings, so still to see what would perform better. In what kind of kind of file types you store your knowledge-base?
- skerit 4y agoThat's very cool. How does it work? Do you train a model for each "library"?
- Vasyl_R 4y agowe're using LangChain underneath and we also doing RnD on fine-tuning to see and compare performance of different approaches. Can you tell me what file format is your knowledge-base? is it PDF or MS Docs or any other?
- punkspider 4y agoLately LangChain[1] and GPT-Index[2] are very popular libraries for this sort of thing. This is the vid I started out with https://www.youtube.com/watch?v=rBEHPxVHb5c https://www.youtube.com/watch?v=rBEHPxVHb5c Also that channel seems to be great. They focus only on LangChain and GPT-Index lately and post videos every few days https://www.youtube.com/@echohive https://www.youtube.com/@echohive Both have Discord servers as well. Additionally there's also this website for GPT-Index ( https://llamahub.ai/ https://llamahub.ai/ ) where people add different "connectors", like loading up your .md files, .docx files, your notion, your slack, etc. [1] https://langchain.readthedocs.io/en/latest/ [2] https://gpt-index.readthedocs.io/en/latest/
- thundergolfer 4y agoThey say they use LangChain, so it's going to be structurally similar to this MVP side-project: https://thundergolfer.com/infinite-ama https://thundergolfer.com/infinite-ama. That's a chat-bot backed by LangChain and OpenAI, which can answer some questions from my knowledge base. It's WIP, I want to add my HN comments into the mix, but the code is here: https://github.com/thundergolfer/modal-fun/tree/main/infinite-ama https://github.com/thundergolfer/modal-fun/tree/main/infinit...
- MrsPeaches 4y agoThis looks cool and it is fulfilling a need for me (I created a duct tape prototype of a similar solution using LangChain). I want to get up and running the 2mins advertised but am struggling to find the docs. Could anyone point out where these are? Is there maybe a video I can follow to test this?
- Vasyl_R 4y agoThanks for your feedback! We have our docs right on our web-page: https://ingestai.io/docs https://ingestai.io/docs but your're very welcome to join our Discord server and we'll guide you thoughout the process in case you have any issue: https://discord.gg/kMpbueJMtQ https://discord.gg/kMpbueJMtQ And yess, we have video in our docs too? Did you find it yet?
- yosai 4y agoIntegrate with MS teams and it will be game changing..
- cloudbee 4y agoMicrosoft themselves will be coming up with that sorta integration? I feel the opportunity of this probably is going along the lines of Intercom (support desk) which can be present in chat tool of the client/customer choice itself ?
- Vasyl_R 4y agoNo sure if they would come up with that in the nearest future. Maybe just adding OpenAI / ChatGPT - it's possible, but I don't think they'e add contextually intelligent bots that would answer queries from your knowledge base.
- cloudbee 4y agoRight, you should try tapping to old conversation history in these support desk and it would make a good difference on the replies. Didn't see any fine-tuning in the website or docs - do you have plan for these ? I am afraod just langchaining would not make it completely context aware.
- Vasyl_R 4y agothanks for your feedback, again! We're considering to add memory, but in some cases, like in group chat's it can make kind a font noise for the context of your chatbot. So we have to be careful with that. Sure, we have docs- here's the link: https://ingestai.io/docs https://ingestai.io/docs and please join our Discor server: https://discord.gg/kMpbueJMtQ https://discord.gg/kMpbueJMtQ where we do our best to assist our users live or even guide throughot the process if needed.
- Vasyl_R 4y agothanks for your comment! Sure, it's even stated on our web-site - our closest releases are: WhatsApp on 2/24, API on 2/25. But we're also woring on adding MS Teams that would be in March 2023. Do you use mainly MS Teams in your organisation?
- wokwokwok 4y agoPrivacy policy: > We will not use or share your information with anyone except as described in this Privacy Policy. ... > We want to inform our Service users that these third parties have access to your Personal Information. The reason is to perform the tasks assigned to them on our behalf. However, they are obligated not to disclose or use the information for any other purpose. Arreeee they? So let me get this straight, you want to take my Super Important Private Data, like, you know, my entire corporate slack history. You'll feed it some arbitrary third party(s) (eg. OpenAI, who's privacy policy is flat out 'we'll use that as training data'), and they are... > obligated not to disclose or use the information for any other purpose. Other than what exactly? Provide some nebulous service to you? Like... training a model on it, or storing it and using it for training other models later, or..? haha... there is: No. Way. That is happening.
- kashnote 4y agoProbably gonna get downvoted for this but people on HN take the Privacy Policy of brand new websites way too seriously. This is probably some template they downloaded from the web, not some sly document they had their nefarious lawyers put together.
- ChatGTP 4y agoOn the other hand, our company has recently mandated that all the software we use needs to have it's license checked over by a lawyer because we've found some fairly nefarious things in some of the software licenses we're using. Don't want to reveal where I work but let's say there's plenty of people working there who understand software licensing already, and some of the things were still missed until under a microscope. So maybe it pays to be skeptical / cautious?
- tchock23 4y agoAs a SaaS vendor I’ve had an uptick in one off requests from legal teams to make changes to our terms. So far, nothing deal breaking (largely because there isn’t anything nefarious in our terms), but I wonder if this will be a trend moving forward.
- yarapavan 4y agoThis is awesome! Congrats IngestAI team!! Do you have any perf numbers, in terms of size and response times? Is there a list of file formats you support? Possible to choose the LLM model as my preference? How does pricing looks like? Again, great execution and useful tool. Thank you for the launch and good luck!
- Vasyl_R 4y agoThanks a lot for your comment and support! Yes, now we support URL links and txt, MS Docs, Excel, PowerPoint formats and expending file formats is one of our top priorities. So please join our Discord server and stay tuned) Thanks for your idea to add possibility to chose among LLM models - we can add it, if users would ask us. Is it possible to ask you to copy/past this request to our #feature-request channel on our Discord ?
- erur 4y agoFirst of all - this sounds like a super high potential concept. The big hurdle I'd see that would keep companies from tampering around with the current version is that there's no info on data protection & security. You won't get companies to share any internal info with a tool like that until that's out of the way - and even then it might require a lot of trust-building. Getting the certifications will be quite a chore though.
- Vasyl_R 4y agoThank you so much for your comment and support! This is amazing how we're received here! Yes, we understand that to get enterprise companies we have to improve our Privacy Policy. Do you think adding possibility for our clients to store your data in your AWS S3 Cloud would be solution?
- erur 4y agoFor what I'd call "stupid" compliance (GDPR,...), allowing for regional storage of data at rest is definitely important. For any internal data where protecting it is a core interest of the company you'll also either need to prove your whole handling is trustworthy or you'll need to design a process that can do all the steps (preprocessing/vectorization/...) on customer controlled hardware. If your solution can run in a customer owned environment without any external dependencies, that could save you a lot of auditing/certification.
- deleted 4y ago[deleted]
- Avshalom 4y agoHey, uh, real quick Vasyl, could you click on all the images below that contain a stoplight?
- Vasyl_R 4y agoHey there, really sorry, but what do you mean by that? (sorry)
- worthless-trash 4y agoBot confirmed, you have failed the captcha.
- Vasyl_R 4y agoI thought I found some captcha on our web-site.. omg)) It was a good one)) Thanks))
- Avshalom 4y agoI mean that I suspect I am replying to an underwhelming demo.
- dstala 4y agoReally cool! I actually tried to build something of this sort using OpenAI, but building trained models was hard. Did hear about langChain, yet to experiment with.
- Vasyl_R 4y agoThanks for your feedback and support! Amazing))) Or you can experiment with IngestAI now)) Have you try it? Create a Telegram bot takes less than 2 minutes- I promise..
- werds 4y agoStart for Free.... then what? give you all my data and then you hold it hostage for a fee which is undisclosed up front.
- Vasyl_R 4y agothanks for your comment Werds, but why so negative? :)) I mention in almost every second comment answer that we also offer possibility that clients store their data on AWS S3 Cloud storage or if you're an enterprise client, we can even put our app on your servers locally. Would that solve your doubts? Have you had any bad experience with data privacy?
- hooande 4y agoYou're still sending the data to OpenAI in the prompts. That's sending arbitrary text from my corporate slack to a 3rd party. Where you host my data before you send it to wherever isn't relevant. Also, "We host with AWS" isn't really a response to "Will my data be secure?"
- Vasyl_R 4y agohey, to clarify we are not learning from your Slack history or slack channels at all. IngestAI is about learning from your knowledge base (markdown, docs, notion, confluence) and using that to answer queries for users within slack channel. Our primary usecase has been to simply learn from public documentation of companies and help answer the queries of community.
- throwawayapples 4y agoHow is this using ChatGPT without a public API?
- Vasyl_R 4y agoWe're at the moment using OpenAI and aim is to provide a ChatGPT like chat experience. And having ChatGPT api access would make it ideal though.
- tibbon 4y agoI love the idea, but no thanks. I'd prefer to keep a version of this running in my own cluster, without data privacy woes.
- leoff 4y agoInteresting product, but it has no pricing information anywhere.
- Vasyl_R 4y agothanks for your comment! Yep, we'd like to define it during our customer discovery, after we gather a lot of feedbacks, crystalize our understanding of the features users like and ask us to add. Maybe you'd be so kind to say how much this kind of products should cost from your POV ?
- aldarisbm 4y agoOP is either 12 or a bot. Please don’t give any of your private and confidential data to these people without due diligence.
- deleted 4y ago[deleted]
- Vasyl_R 4y agoSorry, I could not get what is the meaning of 12 ? From your knowledge base we LangChain it to get the right context and ask answer. How do you envisage a solution of this sort work ? Happy to learn and make it better.
- guluarte 4y agothis is awesome, my son is using this with a bot in discord to learn python
- yieldcrv 4y agoingest.ai PASS ingestai.io Now I feel complete
- haffjuff90 4y ago[dead]
- exploiter 4y agoSuppose If I want my bot to reply with a custom message related to let's a girlfriend query , then how should I do that ? I've tried to upload documents in Library but what after that ?
- exploiter 4y agoIf I want my bot to reply with custom response to a particular set of query let's say girlfriend then how can I do that ? I've tried to upload document in library but what after that ?