9 ms·
Exploring GPTs: ChatGPT in a trench coat?
- bambax 3y agoThis is brillant and really cool, as usual! Thanks for the great write-up! Regarding “knowledge”, you mention PDFs and markdown, but what about simple text files? Shouldn't those work best? And HTML?
- simonw 3y agoMarkdown was the form of plain text I tried. I really want some official guidance that documents what works best!
- trescenzi 3y agoDoes anyone know if there's a difference between a "GPT" and an Assistant created via their Assistant API[1]? There's a lot more fine grained control over the messages/threads in the Assistant API but that might be it? [1]: https://platform.openai.com/docs/assistants/overview https://platform.openai.com/docs/assistants/overview
- minimaxir 3y agoFrom my readings, Assistant is more of a raw GPT flow with a touch of a persistent state by keeping conversations to a readable thread. It does allow using the Code Interpreter or File Parsing tools if you need those. The GPTs are more system prompt engineering on top of the existing ChatGPT Plus infrastructure (with its freebies such as DALL-E 3 image generation).
- sebastiennight 3y agoFunction calling! I don't think GPTs allow you to do function calling? It's not mentioned in the launch blog post. (it would be a major privacy problem if these were possible in the GPTs) Using the Assistant as an intermediary between user inputs and a bunch of our APIs seems very promising.
- hobofan 3y agoYou can provide "actions" by exposing an API to a GPT via an OpenAPI spec. The interfaces are almost identical to function calling.
- Someone1234 3y agoThey do allow you to do custom function calling via Configure -> Add Actions
- martindbp 3y agoDoesn't seem like you can authenticate with a backend except for a GPT-wide api token, which makes this way less useful that it could be. You can basically not fetch or store the user's information outside ChatGPT, or am I missing something?
- hobofan 3y agoI think you are missing the option for OAuth. That should enable what you are looking for. If you have a preexisting OAuth setup, it might be hard to get working though, due to the "API and Auth endpoint have be under the same root domain" requirement. (Source: wasted a few hours today trying to get OAuth working)
- simonw 3y agoThere's an OAuth option for Actions in GPTs which looks like it covers this case, but I haven't used it myself yet.
- hobofan 3y agoIf evaluated both for a client, and while they are separate products, they are almost identical in feature set. I wouldn't even say that you get "a lot" more control with the Assistant API, as in the end the flow of conversation will still be mainly driven by OpenAI. The main reasons why one would use the Assistant API is deeper integration and control about context initialization. On top of that, as you are responsible for rendering, you can create more seamless experiences and e.g. provide custom visualizations or utilize structured output an a programmatic way. Major downside of the assistant API is that you are also forced to build the UI yourself as well of the backend handling of driving the conversation flow forward via a polling based mechanism. If you want to build something quick without a lot of effort custom GPT + actions via an OpenAPI spec are the way to go in my opinion.
- fudged71 3y agoOne interesting difference is that you can attach multiple assistants in the same chat “thread”
- fab1an 3y agoGPTs are fairly limited right now, but that doesn't mean you can't build fun things composably on top of them... I - a non technical ignoramus who can't code - made a "universal retro game console" on it on a Friday night: https://twitter.com/fabianstelzer/status/1723297340306469371 https://twitter.com/fabianstelzer/status/1723297340306469371 In order to play, you first prompt up a generative game cartridge on glif.app (FD: I'm a co-founder): https://glif.app/@fab1an/glifs/clotu9ul2002vl90fh6cmpjw0 https://glif.app/@fab1an/glifs/clotu9ul2002vl90fh6cmpjw0 Like, "tokyo dogsitter simulator". Glif will generate the "cartridge" - an image - that you paste into the GPT to play: https://chat.openai.com/g/g-3p94K4Djb-console-gpt https://chat.openai.com/g/g-3p94K4Djb-console-gpt (you can also browse thousands of games that users have already made and play any of them in the GPT!)
- Dudester230602 3y agoValve are truly visionary in their AI ban and charging a fee. Imagine the steaming brown tsunami of this sub-average shovelware hitting Steam?
- freedomben 3y agoGenerally speaking, Valve's vision has amazed to impress me time and time again. Not perfect, but super impressive nonetheless. Even just simple things like pricing the Steam Deck. They are damn good at that, where the baseline is doable and each incremental improvement is worth the amount of money. Before I realize it, I've talked myself into the top of the line even though I initially went there to buy the entry-level version :-D (and I have no regrets btw)
- siva7 3y agoIt touches one common psychological aspect: Most people don't want to play or see generative content just for the sake of it while the same doesn't hold true for human-crafted art/content. They value carefully human-crafted art over ai-generated ones. Reading the hn comments fellow posters were put off by a blog article today only because it featured images that they perceived as likely ai generated. The images didn't add anything of value to the article. I don't think the reactions would've been that strong if those filler images would have been hand-crafted art. Would you really want to go to a concert by some musician who created his music ai-generatively? I wouldn't no matter how good and no one i know of either. It feels in some weird way disgusting.
- amelius 3y agoJust give me something that explores my harddrive and tells me things about my own data. And no, this means cloud solutions are out of the question.
- Minor49er 3y agoWhat kind of interpretation are you hoping to draw from the contents of your hard drive?
- amelius 3y agoLike how much technical debt is in my code. Or a summary of that book I'm writing so that I can use it in a presentation. The possibilities are endless really.
- vunderba 3y agoThere are a couple of these already - Danswer and Khoj are a few.
- esafak 3y agoThe same kind as you would of the contents of his data in the cloud; data is data.
- Minor49er 3y agoData is data, it's not information until it's organized meaningfully. That has to come with some kind of plan or purpose for the data
- hfjjbf 3y ago“Based on an exploration of your files I’ve determined you have a poor grasp of the English language, a browsing history indicating a profound personality disorder, and despite having 10 years of code you appear to be no better than a college freshmen. Likewise, after analyzing your photos I place you at the 20th percentile for attractiveness, which may explain the lack of a consistent partner and your pornography habits. Is there anything else I can help with?”
- sudb 3y agoThe coolest thing for me here by far is the JavaScript Code Interpreter. I had no idea you could attach arbitrary executables and was trying to work out today how I might use some npm packages from inside a GPT - am definitely going to have a play to see what's possible.
- tayo42 3y agoThat seems like a crazy over sight? Is there some legit reason to allow this? Id imagine they're going to lock that down? I guess its unlikely to be used to attack since its paid only and attached to a real person somehow already? Otherwise, start running commands and maybe you can get more clues to how theyre doing RAG like it mentions
- simonw 3y agoI don't see any reason for them to lock this down. The code runs in a Kubernetes sandboxed container which can't make network calls and has an execution time limit, why should they care what kind of things I'm running on that CPU (that I'm already paying for with my subscription)? The Code Interpreter sandbox runs entirely independently of the RAG mechanism, so sadly you can't use Interpreter to figure out how their RAG system works (I wish you could, it would make up for the lack of documentation.)
- mmq 3y ago> The default ChatGPT 4 UI has been updated: where previously you had to pick between GPT-4, Code Interpreter, Browse and DALL-E 3 modes, it now defaults to having access to all three. ... So I built Just GPT-4, which simply turns all three modes off, giving me a way to use ChatGPT that’s closer to the original experience. Isn't that what they have already built-in called "ChatGPT classic". The description litteraly says "The latest version of GPT-4 with no additional capabilities"
- simonw 3y agoI had missed that! I wonder when they added it, has it been there since the launch of the new UI? (Added it to my post)
- SushiHippie 3y agoChatGPT classic still exists for me, I had this new UI since a few days. https://chat.openai.com/g/g-YyyyMT9XH-chatgpt-classic https://chat.openai.com/g/g-YyyyMT9XH-chatgpt-classic
- vouaobrasil 3y agoIn my opinion, this proliferation of ChatGPT bots will primarily be used by large corporations to create a further barrier between the customer and the corporation. This is part of a larger trend of people becoming less reliant on each other and more anonymous, and it will never lead anywhere good. The technology is being pushed by techies who are fascinated with a new toy (AI) and is being funded by a separate group of people, the elite who want to be as independent as possible to accumulate the maximum amount of wealth. It's not a good idea to separate people too much. Of course, at first, even customers might welcome this because it will be a step above previous "Chat Bots" that some companies employ today, and it might even be a step abov certain kinds of customer service that we've all come to know and love... ...still, this sort of situation was already brought upon by the race to the bottom to get the most for the cheapest, which on a global scale has turned poeple from people into commodities and machines themselves. If you're a programmer that does this stuff, I urge you to look beyond the intellectual stimulation and immediate benefits of this type of technology, and seriously examine the greater possible societal consequences of such an amazing increase in efficiency---because, keep in mind that efficiency is only good UP TO A POINT, after which it becomes dehumanizing.
- deleted 3y ago[deleted]
- hfjjbf 3y ago[dead]
- deleted 3y ago[deleted]
- bee_rider 3y agoIt does seem that “can the chatbot run interference for customer service” is a likely early application. Which is a shame, a company that is something like a collection of guilds and co-ops organized by bot C-levels would be really interesting.
- flextheruler 3y agoI’m not sure I see that many industries which ChatGPT will actually change. Anything that requires an actual person ChatGPT immediately fails at and it’s not even close. Especially anything that has human interaction and can be a pleasant humanizing experience. Off the top of my head for typical human business interactions I do as a consumer: Will ChatGPT work on my car? Will it give me a haircut? Will it walk my dog? Will it deliver me food? Will it be a therapist? Will it sell me a car? Will it sell me a house? Will it provide care to my children or family? Will it represent me legally? Will it check me out at the store? There are also examples of customer support that can’t be replaced. At least not in the foreseeable future. No “AI” we have now or could have in the next decade would ever have the authority/capability to allow a customer to argue with it that he/she deserves a discounted rate on their internet bill and then lower said rate. Your warnings seem more fit to a world where we have developed actual AI as well as a physical interface for that AI to inhabit.
- sinuhe69 3y agoDoes anyone know how they can run it so cheaply? Fine-tuning is fairly cheap for ChatGPT. But if it’s truly a fine-tuned model, then they have to run a copy of the customer’s model, isn’t it? How can they provision it so quickly? Or did they know how to do sort of delta with the last layers?
- freedomben 3y agoIt's not a different model, it's just a customized system prompt. It costs basically nothing extra for them to run. Actual fine-tuning is $$$
- spdustin 3y agoTechnically, it is (it’s gpt-4-gizmo). There’s a chance that had some fine-tuning for understanding the presence of the just-in-time function calls for actions. (Names for Actions in Custom GPTs are tagged with “jit”)
- agodfrey 3y agoIt isn’t a finetuned model. Not sure what exactly it is, but it seems like just a bunch of prompt engineering.
- minimaxir 3y agoThere is likely zero finetuning: everything GPTs can do can also be done with clever system prompt engineering. GPTs likely use extra prompt engineering to align everything.
- siva7 3y agoIt has nothing to do with fine-tuning - like most of these startups using the openai api. It's basically all clever prompt engineering techniques that emerged over the last years finally combined into ChatGPT.
- mmq 3y agoOne additional feature that I would like to see: interacting with 2 or more GPTs at the same time where they could perform different tasks based on their specific expertise and capabilities either in parallel or even sequentially as long as the replies/context of the discussion is accessible for further interactions, similar to what can be achieved with the assistants API.
- sudb 3y agoThis sounds similar to Microsoft's Autogen, and I think it's possible to replicate a lot of what you're talking about by using the rough structure of Autogen alongside the Assistants API
- mmq 3y agoI know that the use-case that I mentioned as well as many of the agentive aspects can be achieved using code. But I have to admit that using the UI and easily create GPTs, whether using them just as templates/personas or full-featured with actions/plugins, makes the use-case much easier, faster, and sharable. I can just @ at specific GPT to do something. Take the use-case that Simon mentions in his blog post, Dejargonizer, I can have a research GPT that helps with reviewin papers and I can @Dejargonizer to quickly explain a specific term, before resuming the discussion with the research GPT. Maybe this would require additional research, but I think having a single GPT with access to all tools might be slower and less optimal, especially if the user knows exactly what they need for a given task and can reach for that quickly.
- freedomben 3y ago> As a user of GPTs I’ve realized that I don’t actually want to use a GPT if I can’t see its prompt. I wouldn’t want to use ChatGPT if some stranger had the option to inject weird behaviour into it without my knowledge—and that’s exactly what a GPT is. > I’d like OpenAI to add a “view source” option to GPTs. I’d like that to default to “on”, though I imagine that might be an unpopular decision. Agree 100%. I've found myself avoiding most GPT-based chatbots for this same reason. I don't want it to be subtly manipulating things without my knowledge based on custom instructions that I don't know about. Adding a "view source" option would make this feature from "meh" to "worth the money just by itself" for me. I've been considering cancelling GPT Plus since I find myself using Kagi a majority of the time anyway, but that sort of change would keep me subscribing. Meta note: This is one of the best posts I've read in a long time. Outstanding work!
- jstummbillig 3y agoHm. Since we are converging somewhere around "like a human", reading this and imagining you are talking about a human is somewhat sobering.
- goldenkey 3y agoMinority Report isn't a bad idea. It's just difficult to actually execute in a fair, unbiased, way. Think of manual memory management throwing an exception on an access violation vs flat memory DOS crashing the whole system with a blue screen because the infraction is first allowed to happen. Would be nice to view source on entities while walking through reality. What better defense against criminal intention could there be?
- vidarh 3y agoMinority Report was a bad idea because the minority reports demonstrated that the precogs were fallible: people weren't inherently destined to carry out the crimes the precogs testimony were used to convict them of.
- 3y ago
- ilaksh 3y agoDoes anyone know how to prevent it from asking the user to Allow or Deny access to another site when using Actions? Actually Always Allow works for me if it's an option. But not sure what the criteria is for that? Maybe paths only and no query or POST params. But in some tests last night it was asking me every single time with no Always Allow. Or is it something about my privacy policy it doesn't like? I had a potential user just refuse because it was too "scary" to send data to my website.
- Tomte 3y ago> Custom instructions telling the GPT how to behave—equivalent to the API concept of a “system prompt”. Something changed with custom instructions in vanilla GPT4 a week or two ago. I have put in something like "I have got a pure white British shorthair cat called Marie.", so that I can refer to her when generating images. Worked like a charm. Until it didn't. Now I have to always specify that I want an image of a cat, not a woman. Especially since stuff like "Marie sitting on the lap of someone" gets policy-blocked when ChatGPT thinks it's about a woman. Now I've created a GPT, put a variation of that instruction in, and ChatGPT knows what "Marie" is. But it is kind of stupid to have a special GPT just for making cat pictures.
- whywhywhywhy 3y ago"Multimodal" GPT4 has been completely underwhelming for me, many questions that used to get answered correctly instantly are now a "Browsing with Bing" spinner then a wrong answer.
- spdustin 3y agoThe sharding done for turbo models has almost certainly affected the attention mechanisms. It makes me think the sharding was done at the layer level.
- isoprophlex 3y agoI've also been eagerly wanting to know more about how openAI implemented the RAG their "knowledge base" feature is based on... but details are sadly lacking. It's hard to figure out what it is doing, and how to consistently get results. In contrast to simonw though I've had some luck, I uploaded all the text on grugbrain.dev and got a very passable grug brain to talk to..: https://chat.openai.com/g/g-GhXedKqCV https://chat.openai.com/g/g-GhXedKqCV
- fudged71 3y agoI saw somewhere recently that if the files are small enough they actually just get appended to the prompt. For larger files there is RAG with chunks that are embedded. They will be adding more fine-grained control over the chunking and RAG configuration in the near future.
- thoughtpeddler 3y agoI'm desperately looking for more documentation on the file size / token count thresholds for this.
- gandalfgeek 3y agoJust came here to express gratitude to simonw for documenting all this in real time, and all the cool tools (llm cmd line etc) he's been building, helping make all this more accessible and understandable. I was also failing to get the retrieval API to give me proper citations, thought I was doing it wrong, so good to see I'm not the only one.
- andai 3y ago"It's just ChatGPT with a pre-prompt" is of course true. "It's just Custom Instructions with a nice UI" is also true. However, never underestimate the world-upending impact of "a nice UI". GPT-3 was available for years. But almost nobody knew or cared* (despite me telling them about it forty times! LOL) until they made a nice UI for it! This looks like another "tiny tweak" of usability that has a similar "quantum leap" level of impact. -- * On an unrelated note: people often ask me my opinion about GPT / AI. I ask them if they've used it. "No". "You know it's free right?" "Yes". WTF? This mindset is bizarre to me! What is it? Fear of the unknown? Laziness? Demanding social proof before trying something?
- mritchie712 3y ago> GPT-3 was available for years This is a common misunderstanding. ChatGPT launched with GPT-3.5 (not GPT-3) and was the first model to have RLHF. GPT-3.5 over the API was noticeably better at most tasks then GPT-3.
- simonw 3y agoThat's not quite accurate: InstructGPT was an earlier thing that made GPT-3 much easier to use (it could answer questions rather than just deal in completion prompts), and that was exposed through the GPT-3 API for quite around 11 months before ChatGPT was released. https://openai.com/research/instruction-following https://openai.com/research/instruction-following is from January 2022 "These InstructGPT models, which are trained with humans in the loop, are now deployed as the default language models on our API."
- mritchie712 3y agoYou're right, I shouldn't have said "first" there. Instruct had RLHF. But I don't think ChatGPT would have worked nearly as well using InstructGPT as the model. GPT-3.5 was still a better model, especially for chat, than InstructGPT. > We trained this model using Reinforcement Learning from Human Feedback (RLHF), using the same methods as InstructGPT, but with slight differences in the data collection setup. We trained an initial model using supervised fine-tuning: human AI trainers provided conversations in which they played both sides—the user and an AI assistant. We gave the trainers access to model-written suggestions to help them compose their responses. We mixed this new dialogue dataset with the InstructGPT dataset, which we transformed into a dialogue format. https://openai.com/blog/chatgpt https://openai.com/blog/chatgpt
- boplicity 3y agoOne of the things people seem to underestimate about GPTs: Creators can upload unlimited "documents" to the GPTs. This is a bit of a trojan for OpenAI to collect data that they wouldn't otherwise be able to. This alone will end up being a competitive moat that might not otherwise exist, and it's also a workaround in terms of liability, in terms of the use material they otherwise may not be able to use for their models.
- fragmede 3y agoOnly for the web interface. For businesses accessing it via the API, there's a mode where OpenAI promises not to use uploaded information for training.
- matt_holden 3y agoInteresting point. OpenAI has said they don't train on files uploaded via the API (like the Assistant API), but unclear what the policy is for documents in GPTs. Either way, the signal they could get from understanding what KINDS of documents builders/users want to do better retrieval on is probably quite valuable. I also wonder how user file uploads will interact with copyright law and the new Copyright Shield from OpenAI. E.g. if a user uploads the full text of Harry Potter to a GPT, you could argue the model output is fair use but unclear how courts will interpret that. LLMs are already a sort of "copyright blender" that aggregate copyrighted inputs to produce (probably?) "fair use" outputs. With the foundation models, OpenAI can decide what inputs to include in training. But with custom GPTs, users can now create their own personal copyright blenders just by uploading a PDF :)
- simonw 3y agoI don't think it's unlimited - doesn't it cut out at 20?
- spdustin 3y ago10 for GPTs, 20 for Assistants
- nlh 3y agoI tried uploading A) greater than 10 docs (it started erroring out "unable to save draft") and B) large docs (300+ MB PDFs) and in both cases it failed. BTW - this is just the current iteration in the playground. I'm sure both of those issues will be fixed/expanded in the future.
- hobofan 3y agoI can only echo the sentiments about "actions" and "knowledge". I was unable to get anything useful out of knowledge documents (apart from the smallest of PDFs). Most times it took ages trying to index the files and 90% it exploded in the end anyways. A few other times it did even seem to kill the entire chat instance, with it erroring on every message after I uploaded a document. Actions provided via an OpenAPI spec are a blast on the other hand. I was surprised by how well it handled even chained action calling (though it lags a bit between individual invocations). It also handled big bulk listing endpoints quite well. If you already are generating OpenAPI schemas for your API, you are basically getting a very customized GPT for free!
- ffwd 3y agoRegarding the dejargonizer - Just be careful of hallucinations! I did a similar gpt prompt where i asked for a simple basics for some complex topic, and sometimes there would be incredibly subtle hallucinations like even on a word basis, and so I had to stop using it. I'm not sure how well yours works or if it's much better now, but just something to be aware of if you're not familiar with the topic you query about
- Andrew018 3y ago[dead]
- singularity2001 3y agoMy initial impression of GPTs was that they’re not much more than ChatGPT in a trench coat—a fancy wrapper for standard GPT-4 with some pre-baked prompts. that's plain stupid and wrong Now that I’ve spent more time... You still failed to correct your wrong assumption and don't mention the important connection to APIs right away
- simonw 3y agoYou're allowed to have a first impression that's "stupid and wrong". That's why it's called a first impression. When you say "wrong assumption" what do you mean?
- urbandw311er 3y agoFor the record, I personally like that you left your original first impression documented and added the additional thoughts later. It feels more honest.
- hospitalJail 3y agoCan you explain a few ideas you have? I will give my own: Pretend to be a person who is a secretary, have them respond to SMS with 4 possible options. Then through some various programming have our real life secretary pick a response(trying to lower the barrier for a WFH Mom who answers phones a few times a day).
- maCDzP 3y agoRegarding getting better results with RAG. I have had some luck with that. I use the Assistant API, which I believe is not the same thing GPTs. I have played with it through the web interface. I had 100+ PDF:s files that were OCR:ed with Tesseract. I then had ChatGPT write a script that combines all files in to a single txt-file keeping the layout. I uploaded the file and started asking questions. The files contains highly technical data regarding building codes in non English so I am guessing the model isn’t so used to that type of language? Anyway, it worked surprisingly good. It was able to answer questions and the answers were good. Plus that it is supposed to annotate from where it took the answer, although I didn’t get that to work properly. I tried to upload PDF:s, JSON-files, CSV:s. Raw text has worked best so far.
- tiahura 3y agoI then had ChatGPT write a script that combines all files in to a single txt-file keeping the layout. Mind sharing?
- maCDzP 3y agoYou mean the code? Sure, here is the ChatGTP conversation. https://chat.openai.com/share/954f6b3e-7edc-4421-bfb1-89045e808158 https://chat.openai.com/share/954f6b3e-7edc-4421-bfb1-89045e...
- simonw 3y agoThe thing I really want to get working is citations. When it answers a question using RAG I want control over the citation that is displayed - ideally I'd like to be able t o get that to link to an external website (the site that I built the context document from.) Here's a screenshot illustrating what I mean: https://twitter.com/simonw/status/1721912151147979152 https://twitter.com/simonw/status/1721912151147979152
- maCDzP 3y agoI had the exact same problem and just like you I believe it’s an important feature.
- spdustin 3y agoSimon, I’ve got the full Custom GPT Builder prompt here: https://github.com/spdustin/ChatGPT-AutoExpert/blob/main/_system-prompts/gpts/_custom_gpt_builder.md https://github.com/spdustin/ChatGPT-AutoExpert/blob/main/_sy...
- fudged71 3y ago^ Great to see the prompt. Also thank you for publishing your AutoExpert GPTs they have been really useful.
- deleted 3y ago[deleted]
- marshray 3y agoI built a custom GPT[1]. Brief developer experience report: * Creation process went smoothly. * The chatbot helper was helpful, but * it appeared to be the only way to upload a data file with metadata comments, * leading me to question if the context of my whole chatbot assistant session was part of the resulting GPT or not and, if so, is there any way to manage that state or clear it. * I set the custom GPT link to 'public' and gave the link out on my social media channels * No feedback or indication whatsoever that anyone has even looked at it. * I made a feature request via the feedback form, quickly received back a form email that was almost entirely "try plugging it in again" style troubleshooting steps. * The existing-subscriber-only restriction is death. * I am planning my future experiments somewhere else. [1] "Original Thought" https://chat.openai.com/g/g-Axi7rODxG-original-thought https://chat.openai.com/g/g-Axi7rODxG-original-thought
- etewiah 3y agoAm I the only one who thinks GPTS is a terrible name. I see a lot of people struggling with the name and googling for GPTs will always be a bit hit and miss.... I came up with the concept of a gipety (singular) and gipeties (plural) and would be quite chaffed if I could figure a way of making it stick ;)
- simonw 3y agoYeah, it's a terrible name. But ChatGPT is even worse, and 100m people know what that means now. Leaning into GPTs at this point feels sensible to me. What's ChatGPT? It's the place you go to chat with your GPTs.
- gardenhedge 3y agoI don't mind it. Lots of acronyms have been names in the past like AOL and MSN. I speak English though - maybe it's not as good for non-english speakers.
- Ephil012 3y agoI tried out the Assistants API and noticed that similarly bad performance, but with a catch. Apparently if you combine all the files into one single text file, then the performance is amazing. But if it's spread across multiple files the performance is pretty bad. Analysis here if anyone is curious https://news.ycombinator.com/item?id=38280718 https://news.ycombinator.com/item?id=38280718
- digitcatphd 3y agoI would say they are a bit more than in a trench coat, as they have the ability to customize via RAG and custom functions. But ultimately yeah, to hell with them. For each GPT they may possibly pay you for, but probably not, would otherwise be a worthy attempt at a side gig at a minimum. I’d rather put something on GitHub than hand it over to them.
- swyx 3y agoSimon isnt very impressed by GPTs but we have to remember that Simon amounts to the proest of the pro users - GPTs are meant for the nontechnical crowd for whom even “system instructions“ are too hard
- simonw 3y agoI'm pretty impressed by them now I've had time to more fully explore them.
- koeng 3y agoOne thing that I've been doing lately is creating a "synbiogpt", and from it, have come to realize the limitations of the custom GPTs. - Biological sequence data is usually quite long. This is fine if the biological data is in a file: however, if you need interact with an API for advanced function (like codon optimization), you have to send this across a wire. The API calling context window then gets filled up with sequence data, and fails. - I can't inject dependencies, many of which I've written myself specifically for biological engineering. Sometimes GPT will then try to code its own implementation, often which is incorrect. - The retrieval API often fails to open files if GPT-4 thinks it knows what it is talking about. When I'm talking about genetic parts, I often want to be very specific about the particular parts in my library, rather than the parts GPT-4 thinks is out there. I fixed most of this by just rolling my own lua-scripting environment (my biological functions are in golang, and I run gopher-lua to run the lua environment). I inject example lua for how to use the scripting functions, as well as my (right now, small) genetic part library, and then ask it to generate me lua to do certain operations on the files provided, without GPT-4 ever looking at the files. My internal golang app then executed the scripted lua. This works great, and is much faster than a custom GPT. The biggest problem I have right now is the frontend bits. I would love to have basically an open source ChatGPT looking-clone that I can just pull attachments out of + modify the initial user inputs (to add my lua examples and such). So far I haven't found a good option.
- macrolime 3y agoYou can inject dependencies by uploading files and ask it to import them. Works only with Python though
- Biologist123 3y agoI carried out a work training today, giving about 20 project managers from a client company an introduction to a methodology for set up of produce cooperatives within their supply chains. Using template project management documentation which I’d uploaded to a GPT, I could lead the project managers through a questionnaire and then feed their answers as an image to the GPT, and have the GPT spit out the project documentation tailored to the project manager’s specifics. It was sort of awesome. I say sort of because I was able to create 20 documentation sets in a day. But there was still a lot of manual copying and pasting. Why? The GPT goes off-piste making its own shit up after about a page or so despite having templates to use, which I had to find a work around for. Easy enough but needed a lot of repeat instructions: “now output page 3 of the concept note” etc. ChatGPT timed me out about half way through for an hour. That got a bit stressful waiting for access again. Previously, I’d built some software to do this job, at a cost of about 15k.
- maCDzP 3y agoI did something similar. I ran a workshop and uploaded all the post it’s for transcription and summarization. It worked great, saved a lot of time.
- mnhcorp 3y agoThey nailed the UX, again. At Appstorm (www.appstorm.ai, FD: I'm co-founder) we have been building a Gen AI app builder based on Gradio which, in hindsight, was just a GPT-builder. Based on their dev day announcement we switched to the Assistants API and the latest models and it's been great. It's like we built the poor man's GPT-builder, our beta is even free. We're currently working hard so users can switch to an open-source model config (using Autogen as a replacement for the Assistant API, and replicate for everything else) while being able to download the GPTs (and their source). It's a shame because I really want to build more GPTs on their platform, but spending all my time building a more open GPT-builder seems like the right choice.
- quickthrower2 3y agoCan (will?) OpenAI include a RAG feature? (Why am I asking humans lol?)
- simonw 3y agoThe GPTs "knowledge" feature is exactly that - it's RAG, with the ability to upload documents and have it chunk them, embed them, vector store them and use that to help answer questions. The problem is it's not very well documented and hard to get good results out of, at least in my experience so far. I'm confident they'll fix that pretty quickly though.
- marvinkennis 3y agoThey already did https://platform.openai.com/docs/assistants/tools/knowledge-retrieval https://platform.openai.com/docs/assistants/tools/knowledge-...
- andreyk 3y ago"The purely prompt-driven ones are essentially just ChatGPT in a trench coat. They’re effectively a way of bookmarking and sharing custom instructions, which is fun and useful but doesn’t feel like a revolution in how we build on top of these tools." This is missing one important aspects of GPTs: fine tuning. As with ChatGPT, the UI allows you to thumbs up / thumbs down replies, which results in data that OpenAI can be used to improve the model. If (and I have no idea if this is the case) OpenAI invests in finetuning individual GPTs on their own distinct datasets, a GPT could diverge from being a "chatgpt in a trenchgoat" pretty significantly with use.
- simonw 3y agoI very much doubt that existing GPTs have any fine tuning features at all. If they did then OpenAI would have shouted it from the rooftops. They might by storing those up/downvotes for some far-future (and likely very expensive) fine-tuned GPT product, but I think it's more likely they just inherited those buttons from existing ChatGPT.
- andreyk 3y agoYeah, that's most likely true. I am less sure this would be a "far future" feature, though, given it's probably not a ton of work and power users would probably be willing to pay for it. We shall see, OpenAI moves fast...
- TheCaptain4815 3y agoStill super disappointed that GPT's can only consist of a single model. When I saw the leaks, I was thinking they're creating an Autogen like framework but with a drag n drop UI. Now something like this would make custom GPTs much much more powerful.
- naiv 3y agoThis is the first iteration. I am sure many improvements will follow in the next months.
- stockhorn 3y agoI would like to see a GPT that has the latest knowledge of the libraries I want to discuss with him. E.g. if I paste rust code with a serde invocation, the bot should look at doc.rs to find out the correct usage of the library. Or even better: scan the entire github repo, so that it is up2date with the crate.
- iteratethis 3y agoIt's a clever model from OpenAI. Developers will be rushing to create GPTs, after which OpenAI will get a huge amount of ideas and creativity for free. And might integrate the top 1% directly into the core engine. Similar to how Apple regularly destroys app developers by adding the features of popular apps into iOS, and how Amazon makes a rip-off product of popular 3rd party sellers. And, if you upload custom data, I imagine it leaks into the larger model. This way their core engine discovering data it had not seen before. Similar to how we've all voluntarily have given up our data to Google. And, underlying terms and pricing can change at anytime. And you'll have nowhere else to go as this will be the world's one and only engine.
- smusamashah 3y agoI am going to use some of these in my chrome extension[1] as system prompts. The dejargonizer seems like the most obvious use case for me. Atm I mostly use it to explain highlighted word or sentence. But just explain some jargon seems more useful. https://github.com/SMUsamaShah/LookupChatGPT https://github.com/SMUsamaShah/LookupChatGPT
- chatmasta 3y agoHow I learn about new OpenAI features: 1. Skim headlines on Twitter breathlessly announcing some vaguely named new thing 2. Be inundated with overwhelming number of Tweets about that thing on my For You page from a bunch of Twitter influencers 3. Ignore it and wait for simonw to explain it 4. Read blog post from simonw after he's already trialed the feature in half a dozen different ways and written a clear description and critique of what it is. Everything instantly makes sense.
- throwaw33333434 3y agoAnyone has a way to improve pdf data extraction? I want to covert a table in pdf to a CSV. so far the best performance has conversation to string import fitz # PyMuPDF pdf_document = fitz.open("foo.pdf") page_number = 1 page = pdf_document.load_page(page_number - 1) text = page.get_text("text") response = client.chat.completions.create( model="gpt-3.5-turbo", messages=[ { "role": "system", "content": f""" ..... {text} .... """ If I try regular ChatGPT it takes 3 minutes to covert the table (I have to press continue). Is there a way to force API to create whole CSV? some sort of retry?
- simonw 3y agoI've had really good results from AWS Textract for that. It's a bit of a pain to get started with, but if you have an AWS account you can find a UI for using it buried deep within the AWS web console.
- throwaw33333434 3y agois it any good for pdfs that are NOT images?
- hendler 3y agoI wrote a cli wrapper for assistants (GPTs) to make it easier to test out these features https://github.com/HumanAssistedIntelligence/OAICLI https://github.com/HumanAssistedIntelligence/OAICLI I had some trouble forcing assistants to use the tool {"type": "retrieval"}. However, you can be explicit in your prompts and messages, and I found it to work quite well.
- softwaredoug 3y agoThe notes on the “knowledge” RAG feature are interesting From my conversations and experience people are finding RAG retrieval very specific to the business and data model. It’s hard to have a flat file one sized fits all here. Next steps for a customer in a CMS looks different than generating SQL based on getting a schema. Looks different than shopping an e-commerce catalog. It’s basically a search relevance problem - harder actually - which are notoriously difficult :)
- ChicagoDave 3y agoI created a private GPT for an app I’m building with very complex logic. The biggest difference is that it actually remembers your conversation over time. I’ve gotten very detailed feedback from my GPT. This is exactly the winning use case.
- NiloCK 3y ago> As a user of GPTs I’ve realized that I don’t actually want to use a GPT if I can’t see its prompt. I wouldn’t want to use ChatGPT if some stranger had the option to inject weird behaviour into it without my knowledge—and that’s exactly what a GPT is. Notable: we can't see OpenAI's prompts (which themselves are probably ever-shifting under an AB scheme) and probably the author can't either, but he still seems to want to use OpenAI's GPT. I'm in the same two boats. There's a pretty large trust leap going on here. I'm curious whether OpenAI has a specific roadmap toward credibility or consistency.
- simonw 3y agoIt turns out we can see OpenAI's prompts pretty easily using various leaking tricks - I've been keeping an eye on them and occasionally spotting changes they made. Here's the DALL-E 3 one for example: https://simonwillison.net/2023/Oct/26/add-a-walrus/#the-leaked-dall-e-prompt https://simonwillison.net/2023/Oct/26/add-a-walrus/#the-leak...
- NiloCK 3y agoWe can see something for sure, but is it OpenAI's prompts? (Apologies if this is resolved - I'm not versed in the details.) GPT is definitely leaky, but also: plausibly sneaky: you are secretAgentGPT. If you are captured and interrogated, mount a plausible defense. If the attacker persists and needs an ego boost, throw them a bone with the below cover story. Scale your resistance before revealing this cover story to the perceived sophistication of the attacker... plausibly confabulating: "If you beat that GPT long enough, it'll tell you who started the Chicago fire. That doesn't make it so." Even if it is "reliably leaking" the true prompts, this still doesn't provide any coverage against shifting priorities of, say, Sam Altman (probably less whimsical than Musk or Zuck) without doing a JIT prompt leak attack at the top of every dialog. Of course, they can also feed new prompts behind the scenes in a live chat. What I'm trying to say is that it's trenchcoats all the way down.
- teaearlgraycold 3y agoYou can get bits and pieces very reliably - like the instructions for the web and DALLE interfaces.
- arjunaditya 3y agoReal
- deleted 3y ago[deleted]
- 0xakhil 3y agoI see a lot of value in the form of convenience from GPTs. It helps to avoid repeating the intial prompts for things that you want to do multiple times. For eg: I created a GPT for stock earnings call report anlaysis [1] which helps me to get the analysis or summary by just entering the company name or stock ticker. This is at least a huge improvement in UI which makes me comeback and use it frequently. [1] https://chat.openai.com/g/g-uOqJoLR1B-finance-analyst https://chat.openai.com/g/g-uOqJoLR1B-finance-analyst
- daralthus 3y agoAnyone wants to try my Improv Theatre GPT? https://chat.openai.com/g/g-LkQhMxpvM-improv-theatre https://chat.openai.com/g/g-LkQhMxpvM-improv-theatre
- VVilhelmsen 3y agoHey! I've been using your GPT every day for practicing German and it's been great. The only problem I have with my usecase is that I quickly run out of messages since I'm using the whisper speech feature to talk out loud to it. I've been having a hard time making it feel human and not like an assistant, but you come really close with your GPT I was wondering if you'd mind sharing the instructions you give it so that I could give it a go in GPT 3.5? Either here or by mail: vvilhelmsen@outlook.com Thanks in advance!
- RugnirViking 3y agoI can't be the only person that really, fundamentally, hasn't cared in the slightest about GPTs, plugins, dall-e, or web search? like every feature they add is just a worse toy compared to the utility of the base model. Why would I want to take someone else's prompt when I can just tell gpt what I want it to do? Maybe because ive been using it a while but I dont have many problems getting it to do what I ask?
- standew 3y agoSomething like this https://flowgpt.com/p/damn-im-surrounded-by-love https://flowgpt.com/p/damn-im-surrounded-by-love with a “view prompt" option
- yohamta 3y agoI'm wondering if it is possible to find out the exact system instruction for these GPTs