7 ms·
Show HN: CopilotKit- Build in-app AI chatbots and AI-powered textareas
- swiftlyTyped 3y agoOpen-Source (MIT). If you'd like to contribute to the repo, or to the open copilot protocol, please join the GitHub/Discord!
- deleted 3y ago[deleted]
- squirrel23 3y agoPretty cool tech!
- swiftlyTyped 3y agoThank you!
- nathan_tarbert 3y agoThis is great, if I understand correctly I just inject the hook - <CopilotPortal /> ?
- swiftlyTyped 3y agoThanks! And Pretty much! You have to wrap the app (or the part you want copilot in) with a <CopilotProvider /> - this is UI-agnostic, business logic only. Then there are a few customizable UI providers you can use, or you can just build your own if needed. If you check it out do let me know what you think!
- vecplane 3y agoCool concept! Would this work with React Native, now or in the future?
- swiftlyTyped 3y agoWe're starting with react web, planning to expand from there to other surfaces, including React Native. I suspect the gap from the current version, to React Native support is rather small. It's open-source, so feel free to open an issue so that it can get upvoted/prioritized, (or even better, you can work on it too ;) )
- htsh 3y agoCool! Any plans for Svelte?
- dschofie 3y agoSuper cool! Heads up: when clicking "website" next to "Join our Discord" on your repo, it looks like the link is broken
- swiftlyTyped 3y agoThanks for the pointer, fixed!
- netsharc 3y agoFeels like Microsoft might send you a letter soon about the nane... How about FirstOfficerKit, but that seems very far away from AI if one doesn't get that it's a synonym for copilot
- deleted 3y ago[deleted]
- swiftlyTyped 3y agoYeah, I hope that doesn't happen. That said the concept of a copilot is pretty generic, so hopefully we can peacefully coexist. They've doubled down on the Copilot naming after the project was well underway, and I don't really want to rename it in anticipation of trouble that may never materialize
- petercooper 3y agoIt feels like MS is already treating it like a generic term. I think I saw a Kevin Scott article recently where he kept referring to "copilots" as well. The term is being so widely used right now that they'd need to defend it quickly if they even have a trademark. (Looking at the USPTO database, MS applied for a trademark for "Microsoft Copilot" in September then filed an express abandonment a few days later.)
- dontupvoteme 3y agoThe term is just blatantly lifted from an entire other industry, can you really trademark that?
- netsharc 3y agoIt's an airline term, I am not a lawyer at all but I feel like there's an argument somewhere that using it as a brand for an intelligent/computer assistant, or, fine if you want to be buzzwordy, AI assistant on a computer is a novel use. A bit like "Apple". If you open a computer store named Apple, I think you can't get away with the argument that "It's a term from the agriculture industry!".
- aragonite 3y agoRelately: I've noticed that if I use ChatGPT in Microsoft Edge, I get (sometimes very) helpful co-pilot style completions in the input text area. Is that an Edge-exclusive feature? And how does CopilotKit compare?
- sdrinf 3y agoSo, wait, edge posts non-submitted content you've entered into textboxes to a cloud llm? or is this running in your browser?
- aragonite 3y agoI now think it's likely I misunderstood what the feature involves and that it is actually way more limited than I thought compared to CopilotKit (perhaps it's little different from Gmail's Smart Compose), but this is a quick-and-dirty screenshot: https://imgur.com/a/FwZu6f7 https://imgur.com/a/FwZu6f7
- swiftlyTyped 3y agoI didn't know ChatGPT + Edge did that, pretty cool! And yes, with CopilotKit you can implement the same to any text area in any app, that would work on any browser (+ other key features). I can tell you that CopilotTextarea works very, very well if you give it the right context - but since I hadn't known about Edge's feature, I can't compare. Even long term, I think this is functionality that will be better offered by the app itself rather than the browser - bc the app can control the relevant context beyond what's visible on the screen (e.g. RAG on users' backend state), customize the prompt, and potentially even design dedicated LLM chains (as needed).
- qoxorr 3y ago[dead]
- ulidabess 3y agoAwesome project. I was looking through the Github and if I understand correctly, then it's plugged in to the OpenAI API by default? Is there an option for using other LLMs with it?
- ugh123 3y agoBeing able to plug this into Google Docs using your own local LLM would be very interesting...
- swiftlyTyped 3y agoCorrect. The default backend implementation uses OpenAI, but you can use any LLM pretty easily.
- ulidabess 3y agoAwesome, thanks!
- BonoboIO 3y agoSo this has nothing to do with Copilot from GitHub?
- swiftlyTyped 3y agoCorrect, Copilot here stands for AI "second brain" that "co-pilots" the app alongside the user. (the abstract idea behind GitHub Copilot).
- BonoboIO 3y agoWell it’s kind of misleading, because GitHub has kind of a following for their product named Copilot. I think renaming it would benefit everyone.
- turnsout 3y agoMicrosoft also has an AI feature called Copilot. I think at this point the name has become a generic term for AI assistance.
- dragonwriter 3y ago> > Well it’s kind of misleading, because GitHub has kind of a following for their product named Copilot. > Microsoft also has an AI feature called Copilot. I think at this point the name has become a generic term for AI assistance. Github is Microsoft, and, yes, Microsoft has expanded their Copilot branding for end-user-facing AI assistance beyond just the Github coding tool, but that doesn't make it generic.
- jay-barronville 3y agoCool idea!
- swiftlyTyped 3y agoThanks!
- deleted 3y ago[deleted]
- mikigraf 3y agoAmazing product! How does the connection to LLMs works? Bring your own LLM/API key?
- swiftlyTyped 3y agoYes, exactly. And thanks for the kind words!
- throw03172019 3y agoLooks fantastic but does it require using your endpoints for inference? We have strict data requirements and use Azure OpenAI for security.
- croes 3y agoAzure and security in one sentence. Good one.
- throw03172019 3y agoYes but They sign BAA for HIPAA. OpenAI does not last we checked.
- esafak 3y agoThat's a business associate agreement, for people outside the HIPAA world. https://www.hhs.gov/hipaa/for-professionals/privacy/guidance/business-associates/index.html https://www.hhs.gov/hipaa/for-professionals/privacy/guidance...
- swiftlyTyped 3y agoGood question! No, we actually don't even offer our own endpoints for inference yet, precisely because of the data concerns you site. Right now it's self-host only, but it's very very easy to self-host, and we'll keep it that way for every feature touching user data.
- zerkten 3y agoWhy use the Copilot name? It's confusing because you seem to have an agnostic product.
- deleted 3y ago[deleted]
- swiftlyTyped 3y agoIt's a fair point :) AI Copilot started out synonymous with code completion, it still means that for many. Our bet was this meaning would broaden with time.
- CharlesW 3y agoNow that it’s firmly entrenched as Microsoft branding you may want to reconsider. Soon, people searching for “AI Copilot” aren’t going to be able to find you.
- swiftlyTyped 3y agoIt's a fair point. Remains to be seen if it'll become a common word, or Microsoft-associated.
- ryanjshaw 3y agoMicrosoft is using the Copilot term everywhere - in GitHub, Visual Studio, all the Office apps etc. They have rebranded the Power Platform Virtual Agents builder as "Copilot Studio", and chatbots in your projects are known as copilots. I would be very surprised if you didn't receive legal challenge to your use of the name, if you grow in popularity.
- _mme 3y agoNice project! I made Beak.js which has a similar way to connect a language model to the UI via React hooks: https://github.com/mme/beakjs https://github.com/mme/beakjs
- jakiestfu 3y agoI'm really liking the agnosticism with Beak.js. Would love to read a blog post about the power of that or examples of useBeakFunction use-cases
- swiftlyTyped 3y agoGreat minds think alike! Our `useMakeCopilotActionable` is similar to your `useBeakFunction` and `useMakeCopilotReadable` is analogous to your `useBeakInfo`. I don't know how much farther you're planning to take things or if it's a demo/hobby project. But real talk, if you're excited about this space and would like to explore joining our team, I'd love to chat and take it from there. atai at copilotkit dot ai
- xixixao 3y agoHere's an open source alternative with context retrieval and message storage: https://github.com/get-convex/convex-ai-chat https://github.com/get-convex/convex-ai-chat (there are also versions using Assistants API and LangChain, linked from here: https://stack.convex.dev/ai-chat-using-openai-assistants-api https://stack.convex.dev/ai-chat-using-openai-assistants-api)
- deleted 3y ago[deleted]
- swiftlyTyped 3y agoCopilotKit itself is open-source, and supports assistants API + langchain :) https://github.com/CopilotKit/CopilotKit https://github.com/CopilotKit/CopilotKit
- NoraCodes 3y agoIf I see functionality like this on a company's website, I am going to find someone else to do business with about 80% of the time.
- asadalt 3y agowhy? Doesn't this generally help you write faster?
- Racing0461 3y agoAny chatbot/AI that i can't say "please refund this order due to product being damaged here is a pic" and it can't do a refund on its own is worthless. Not because i care about refunds, but if the bot can't do that, chances are it can't do anything real and its just trained on a bunch of docs and is worthless otherwise. It's also 10x worse when the website has a green circle on it like teams/zoom showing it as "online" and makes you feel like you are actually talking to someone.
- swiftlyTyped 3y agoObviously we'll let customers decide how to deploy this tech, but our vision is less about "chat with AI customer support", and more "tap into intelligence to help you achieve your task". I personally fell in love with copilots when all my engineering tools started adding them (e.g. Cursor IDE, Warp terminal, etc.). And really, I wanted to tap into artificial intelligence everywhere, from excel to planning a vacation in AirBnb. "is this a good place to stay with a young kid?" Just in recent months, the market has validated this intuition, e.g. Microsoft Copilot products (think 2nd-brain-on-tap for e.g. PowerPoint, not support chat) have boosted productivity by 30%, with lots of other impressive metrics --- If you do go back to the customer support use-case, I'd see the support agent's software using CopilotTextarea, to let them reply to 10x more messages, but where they still drive the conversation. Though I could see it coupled with AI chatbot on the consumer side, where it makes sense
- willsmith72 3y agoas a consumer i totally agree but having been on the other side, requests like yours are the exception. support chatbots relieve a huge load, allowing the real people to work on real requests like yours rather than the numerous junk ones.
- AYoung010 3y agoGrow your OpenAI bill exponentially with this one easy trick! In all seriousness — looks nifty! Do you guys have any plans to bring suggestion latency down from what’s show in the demo?
- swiftlyTyped 3y agoLatency is actually very low as-is, with GPT-4-Turbo! But other than that, yes, we do have plans - using real-time RAG. I carried out some research with incredibly promising results https://ai88.substack.com/p/rag-vs-context-window-in-gpt4-accuracy-cost https://ai88.substack.com/p/rag-vs-context-window-in-gpt4-ac...
- geniium 3y agoPretty cool idea
- swiftlyTyped 3y agoThank you!
- dfxm12 3y agoMicrosoft recently rebranded their chatbot offering to Copilot Studio. Copilot is also the name of Microsoft's AI products. It's hard enough keeping all of Microsoft's products with similar names straight. I don't want to confuse other products with them, too, unless, maybe, this is the point :)
- deleted 3y ago[deleted]
- itslennysfault 3y agoIt'd be nice if this was more clearly labeled as a React plugin. I saw "drop in replacement for <textarea>" and thought it was a web component and only realized it was a react plugin after reading further. Not a huge deal, but since it is a plugin and not a stand-alone thing it might make sense to make that clear up front.
- swiftlyTyped 3y agoThanks for the feedback! I'll update the docs.
- swiftlyTyped 3y ago(also, I know that wasn't your core concern, but we are planning to build SDKs for other frontends in the not too distant future!).