21 ms·

Show HN: SlickGPT

72 points by Shackles 4y ago

SlickGPT is a light-weight "use-your-own-API-key" ChatGPT client written in Svelte. It offers GPT-4 integration, a userless share feature and other superpowers.

deleted 4y ago
[deleted]
wingworks 4y ago
Simple, clean UI, I like it.
filenox 4y ago
As with other OpenAI based applications, I don't feel comfortable sharing my private API key with an application I don't know. Especially when the webpage isn't telling me what this app is about. I suggest adding a small demo video or at least adding some bullets on what this app is trying to solve.
- pmarreck 4y ago
  OpenAI’s API key page lets you issue new keys, see when they were last used, and withdraw them at any time. So this seems a bit paranoid.
  - bastawhiz 4y ago
    Stripe's dashboard lets you do the same thing but like hell I'm giving you my secret key.
    - pmarreck 4y ago
      This is a standard way to grant API access in literally every piece of software that's provided an API access I've ever used in the last 5-10 years. I'm not sure what informs such paranoia.
      - bastawhiz 4y ago
        Absolutely incorrect. This is the literal purpose of OAuth.
  - osigurdson 4y ago
    True, but it is still weird to paste your credentials into an unknown service.
    - sbarre 4y ago
      Yes of course, it certainly is. So before you do that, you should make the service not be unknown to you. Good thing this is open source!
      - osigurdson 4y ago
        I’m not sure if there is any way to tell if an open source service is actually using the open source code. It still comes down to trusting the url.
- bertman 4y ago
  It's a self-hostable chat interface for the OpenAI GPT API. From their Github Readme: SlickGPT allows you to run your own local ChatGPT instance, host it yourself or just use our instance if you like. Users bring their own OpenAI API keys. SlickGPT offers them a very fancy user interface with a rich feature set like managing a local chat history (in the localStorage), a userless "Share" function for chats, a prominent context editor, and token cost calculation and distribution. https://github.com/ShipBit/slickgpt https://github.com/ShipBit/slickgpt
  - danpalmer 4y ago
    > SlickGPT allows you to run your own local ChatGPT instance I find it interesting that so many projects claim to be "run your own ChatGPT", when they're in fact "run your own web UI". Are people really so ignorant of how this works that they're equating these concepts, or believing that the web UI is anything more than a razor thin veneer? I guess maybe people use ChatGPT to refer to the interface, and GPT-N to refer to the models, but that's not very accurate given the amount of tuning, it's much more accurate to say that ChatGPT is a productised GPT instance, with a web UI.
    - totetsu 4y ago
      Its like when everything became an 'app' all of a sudden.
    - sebzim4500 4y ago
      You can use the same model that ChatGPT uses through the API, and it isn't called 'ChatGPT' it's called 'GPT-4'. So at least officially ChatGPT refers to the webUI not the model.
      - danpalmer 4y ago
        I'm not sure that's true though. The first line of the ChatGPT blog post is: > We’ve trained a model called ChatGPT which interacts in a conversational way It really seems that GPT-3/3.5/4/etc are the generic models, and that ChatGPT is the fine tuning, a safety layer, and so on. This is also why ChatGPT and Bing don't provide the same or even remotely equivalent answers despite both running on GPT-4.
- Shackles 4y ago
  I get that fear and it's fair. SlickGPT is OS, self-hostable and just runs locally, so you can check the code and run your own instance if you don't trust that ours running on Vercel is on-par with the one in the repo. You can also put a soft and hard cap on your API quota on the OpenAI page and monitor it to verify that only you are using it. The key is passed (see https://github.com/ShipBit/slickgpt/blob/main/src/lib/ChatInput.svelte https://github.com/ShipBit/slickgpt/blob/main/src/lib/ChatIn...) to a Vercel edge function (see https://github.com/ShipBit/slickgpt/blob/main/src/routes/api/ask/%2Bserver.ts https://github.com/ShipBit/slickgpt/blob/main/src/routes/api...) that does the actual call to the OpenAI API. This function is stateless and doesn't store anything. I also put it in your localStorage using a store (see https://github.com/ShipBit/slickgpt/blob/main/src/misc/stores.ts https://github.com/ShipBit/slickgpt/blob/main/src/misc/store...) so that you don't have to enter it over and over again. As for the "what is this trying to solve" - read our documentation in the GitHub repo over at https://github.com/ShipBit/slickgpt https://github.com/ShipBit/slickgpt.
- bsoni 4y ago
  100% agreed! I don't feel like sharing my API key either! Too bad, I wanted to see if it can understand Simplified Chinese.
swah 4y ago
Like the big ui, reminds me of 37signals (I think?)
jeroenhd 4y ago
Design wise it's not bad, but for some reason it takes a while second for the words I type on my phone to appear in the prompt area. Quite a pity.
- Yoda3000 4y ago
  Is it slow while typing on your phone or is it slow showing the characters in the input field? Which phone do you use?
  - thrwy_918 4y ago
    It's very slow when typing characters in the input field. It feels like a react application that's doing a bunch of component re-rendering on every keypress.
    - Shackles 4y ago
      Got it, it's a bug and happens because of the token calculation. We'll fix it. Thanks for reporting.
zb3 4y ago
Typing is very slow, that needs to be fixed.
- Shackles 4y ago
  Do you mean if you type something or if you retrieve the answer/completion from ChatGPT? Which model are you using?
  - cbenz 4y ago
    I tried and just typing letters is slow, they appear ~1 second after typing. Deleting text is slow also. I'm under Linux+Chrome.
1xdevloper 4y ago
If you're using a third-party UI for ChatGPT, it might as well be a browser extension [0] or a native app [1]. It really shines when you break it out of its website interface and start using it like a command palette/context menu. [0] https://sublimegpt.com https://sublimegpt.com [1] https://macgpt.com https://macgpt.com
- manojlds 4y ago
  Yeah I don't even understand the point of this SlickGPT.
  - Shackles 4y ago
    It's a userfriendly web client for the latest OpenAI chatCompletion API with additional features compared to the official chat.openai.com client (mainly: "Share chats" & better param customization), it's Open Source and can be run locally or self-hosted easily. It's built in one of the most popular frontend tech stacks of the last years. Not more and not less than that.
  - joshka 4y ago
    Have you tried regularly using the ChatGPT interface from your phone? It’s obvious that the UI is written by people that don’t take UX seriously.
- otherworldly 4y ago
  Agreed! I've found that staying in my workflow leads to fewer inadvertent context switches (like ChatGPT in-browser -> HN -> ... -> rabbit hole). MacGPT looks great. I created a similar plugin for my Windows keystroke launcher (think Alfred/Spotlight) for the same reason. If anyone's interested, you can check it out here: https://github.com/dkgv/pinpoint https://github.com/dkgv/pinpoint
- jinay 4y ago
  I'm beginning to think there's one too many of these kinds of apps, but if anyone is interested in a cross-platform (Mac, Linux, Windows) alternative, I've built a command-palette type interface [1] to GPT that supports code blocks/LaTeX too. [1] https://github.com/JinayJain/gpt-anywhere/releases/latest https://github.com/JinayJain/gpt-anywhere/releases/latest
gitgud 4y ago
Clean UI, loads fast, but there's significant latency when I type a prompt into the text box... probably client state being debounced or something
- solumunus 4y ago
  This. There is very noticeable latency when typing. This is on a very powerful desktop PC using Chrome. If you hold down a character on your keyboard it shows the issue more clearly, the input will sporadically appear every few seconds.
  - Shackles 4y ago
    Okay, this shouldn't happen. Please create a GitHub issue, I'll investigate.
smusamashah 4y ago
There is also https://niek.github.io/chatgpt-web/ https://niek.github.io/chatgpt-web/
- dvcrn 4y ago
  Heh, I wrote one too (in Elixir + LiveView) - https://github.com/dvcrn/chatgpt-ui https://github.com/dvcrn/chatgpt-ui Background was that we wanted to explore providing access to ChatGPT to employees at $company, but restrict access with Google OAuth using company email, and use the company OpenAI API key on the back. So I hacked together something quick that matches our requirements and we can self-host.
- itsuka 4y ago
  I just started putting together these Chat API-based UIs in this repo, in case anyone's interested: https://github.com/itsuka-dev/awesome-chatgpt-ui https://github.com/itsuka-dev/awesome-chatgpt-ui
detrites 4y ago
> SlickGPT allows you to run your own local ChatGPT instance No, it doesn't. If it did, it would be a 700GB+ download and not need OpenAI API keys. Wish folks would stop saying it.
- Shackles 4y ago
  You're right. Fixed wording in our README on Github, can't edit HN post. Thanks
- deleted 4y ago
  [deleted]
- Tepix 4y ago
  German press is just as bad: https://www.golem.de/news/ki-auf-dem-intel-8088-entwickler-bringt-chatgpt-auf-ms-dos-zum-laufen-2303-172966.html https://www.golem.de/news/ki-auf-dem-intel-8088-entwickler-b... "Entwickler bringt ChatGPT auf MS-DOS zum Laufen" in English: "Developer gets ChatGPT to run on MS-DOS".
  - neuronic 4y ago
    This portion is especially hilarious: "Auf den Entwickler kam allerdings direkt eine weitere Hürde hinzu: MS-DOS integriert nativ keinen Netzwerk-Stack oder eine entsprechende API. Die ist allerdings für den Zugriff auf ChatGPT zwingend notwendig." DeepL: "However, the developer was immediately faced with another hurdle: MS-DOS does not natively integrate a network stack or a corresponding API. However, this is absolutely necessary for accessing ChatGPT." Golem is a very highly frequented German technology website.
- throwaway49593 4y ago
  ChatGPT is the name of a frontend app/service (albeit a first-party one). The model itself is called gpt-3.5-turbo. I think you're wrong on this one.
  - KomoD 4y ago
    > We’ve trained a model called ChatGPT which interacts in a conversational way. > ChatGPT is a sibling model to InstructGPT OpenAI's own words
H8crilA 4y ago
I'm missing the purpose of this.
- yreg 4y ago
  It seems to me that ChatGPT's history archive is down 98% of the time, so that would be one reason for using a custom web UI.
  - moffkalast 4y ago
    Has anyone ever needed that history? I sure haven't. It's like having a copy of every google search and result you ever got, entirely pointless.
    - gremlinsinc 4y ago
      I think it'd be better if you could just 'save' the ones you want to keep, the rest are automatically discarded.
    - taylorfinley 4y ago
      I found it very helpful when writing a blog post series about teaching GPT to translate ROT13-encoded text--instead of documenting each prompt as I went, I could just get into a flow state with the model and try a bunch of things, going back later to pick the moments that gave me an insight.
    - yreg 4y ago
      I needed it many times (and it was often unavailable). When I wanted to continue with previous conversation or refer back to something GPT said. I even experienced it indirectly when I asked someone on reddit about a prompt they have used to make something (generate a pretty good video script) and OP said that they would gladly share it, but unfortunately the history was down. I don't use GPT to get information in a search-engine manner.
    - circuit10 4y ago
      Yes, all the time, it's very frustrating to use it without it
antibasilisk 4y ago
Why?
- JoeJonathan 4y ago
  I was wondering the same. The HN cheerleading for members of the tribe makes this place feel like a recipe blog. "Looks yum! Can't wait to tryy." 5 stars.

Show HN: SlickGPT

72 points by Shackles 4y ago

SlickGPT is a light-weight "use-your-own-API-key" ChatGPT client written in Svelte. It offers GPT-4 integration, a userless share feature and other superpowers.

deleted 4y ago

[deleted]

wingworks 4y ago

Simple, clean UI, I like it.

filenox 4y ago

As with other OpenAI based applications, I don't feel comfortable sharing my private API key with an application I don't know. Especially when the webpage isn't telling me what this app is about. I suggest adding a small demo video or at least adding some bullets on what this app is trying to solve.

pmarreck 4y ago
OpenAI’s API key page lets you issue new keys, see when they were last used, and withdraw them at any time. So this seems a bit paranoid.
- bastawhiz 4y ago
  Stripe's dashboard lets you do the same thing but like hell I'm giving you my secret key.
  - pmarreck 4y ago
    This is a standard way to grant API access in literally every piece of software that's provided an API access I've ever used in the last 5-10 years. I'm not sure what informs such paranoia.
    - bastawhiz 4y ago
      Absolutely incorrect. This is the literal purpose of OAuth.
- osigurdson 4y ago
  True, but it is still weird to paste your credentials into an unknown service.
  - sbarre 4y ago
    Yes of course, it certainly is. So before you do that, you should make the service not be unknown to you. Good thing this is open source!
    - osigurdson 4y ago
      I’m not sure if there is any way to tell if an open source service is actually using the open source code. It still comes down to trusting the url.
bertman 4y ago
It's a self-hostable chat interface for the OpenAI GPT API. From their Github Readme: SlickGPT allows you to run your own local ChatGPT instance, host it yourself or just use our instance if you like. Users bring their own OpenAI API keys. SlickGPT offers them a very fancy user interface with a rich feature set like managing a local chat history (in the localStorage), a userless "Share" function for chats, a prominent context editor, and token cost calculation and distribution. https://github.com/ShipBit/slickgpt https://github.com/ShipBit/slickgpt
- danpalmer 4y ago
  > SlickGPT allows you to run your own local ChatGPT instance I find it interesting that so many projects claim to be "run your own ChatGPT", when they're in fact "run your own web UI". Are people really so ignorant of how this works that they're equating these concepts, or believing that the web UI is anything more than a razor thin veneer? I guess maybe people use ChatGPT to refer to the interface, and GPT-N to refer to the models, but that's not very accurate given the amount of tuning, it's much more accurate to say that ChatGPT is a productised GPT instance, with a web UI.
  - totetsu 4y ago
    Its like when everything became an 'app' all of a sudden.
  - sebzim4500 4y ago
    You can use the same model that ChatGPT uses through the API, and it isn't called 'ChatGPT' it's called 'GPT-4'. So at least officially ChatGPT refers to the webUI not the model.
    - danpalmer 4y ago
      I'm not sure that's true though. The first line of the ChatGPT blog post is: > We’ve trained a model called ChatGPT which interacts in a conversational way It really seems that GPT-3/3.5/4/etc are the generic models, and that ChatGPT is the fine tuning, a safety layer, and so on. This is also why ChatGPT and Bing don't provide the same or even remotely equivalent answers despite both running on GPT-4.
Shackles 4y ago
I get that fear and it's fair. SlickGPT is OS, self-hostable and just runs locally, so you can check the code and run your own instance if you don't trust that ours running on Vercel is on-par with the one in the repo. You can also put a soft and hard cap on your API quota on the OpenAI page and monitor it to verify that only you are using it. The key is passed (see https://github.com/ShipBit/slickgpt/blob/main/src/lib/ChatInput.svelte https://github.com/ShipBit/slickgpt/blob/main/src/lib/ChatIn...) to a Vercel edge function (see https://github.com/ShipBit/slickgpt/blob/main/src/routes/api/ask/%2Bserver.ts https://github.com/ShipBit/slickgpt/blob/main/src/routes/api...) that does the actual call to the OpenAI API. This function is stateless and doesn't store anything. I also put it in your localStorage using a store (see https://github.com/ShipBit/slickgpt/blob/main/src/misc/stores.ts https://github.com/ShipBit/slickgpt/blob/main/src/misc/store...) so that you don't have to enter it over and over again. As for the "what is this trying to solve" - read our documentation in the GitHub repo over at https://github.com/ShipBit/slickgpt https://github.com/ShipBit/slickgpt.
bsoni 4y ago
100% agreed! I don't feel like sharing my API key either! Too bad, I wanted to see if it can understand Simplified Chinese.

swah 4y ago

Like the big ui, reminds me of 37signals (I think?)

jeroenhd 4y ago

Design wise it's not bad, but for some reason it takes a while second for the words I type on my phone to appear in the prompt area. Quite a pity.

Yoda3000 4y ago
Is it slow while typing on your phone or is it slow showing the characters in the input field? Which phone do you use?
- thrwy_918 4y ago
  It's very slow when typing characters in the input field. It feels like a react application that's doing a bunch of component re-rendering on every keypress.
  - Shackles 4y ago
    Got it, it's a bug and happens because of the token calculation. We'll fix it. Thanks for reporting.

zb3 4y ago

Typing is very slow, that needs to be fixed.

Shackles 4y ago
Do you mean if you type something or if you retrieve the answer/completion from ChatGPT? Which model are you using?
- cbenz 4y ago
  I tried and just typing letters is slow, they appear ~1 second after typing. Deleting text is slow also. I'm under Linux+Chrome.

1xdevloper 4y ago

If you're using a third-party UI for ChatGPT, it might as well be a browser extension [0] or a native app [1]. It really shines when you break it out of its website interface and start using it like a command palette/context menu. [0] https://sublimegpt.com https://sublimegpt.com [1] https://macgpt.com https://macgpt.com

manojlds 4y ago
Yeah I don't even understand the point of this SlickGPT.
- Shackles 4y ago
  It's a userfriendly web client for the latest OpenAI chatCompletion API with additional features compared to the official chat.openai.com client (mainly: "Share chats" & better param customization), it's Open Source and can be run locally or self-hosted easily. It's built in one of the most popular frontend tech stacks of the last years. Not more and not less than that.
- joshka 4y ago
  Have you tried regularly using the ChatGPT interface from your phone? It’s obvious that the UI is written by people that don’t take UX seriously.
otherworldly 4y ago
Agreed! I've found that staying in my workflow leads to fewer inadvertent context switches (like ChatGPT in-browser -> HN -> ... -> rabbit hole). MacGPT looks great. I created a similar plugin for my Windows keystroke launcher (think Alfred/Spotlight) for the same reason. If anyone's interested, you can check it out here: https://github.com/dkgv/pinpoint https://github.com/dkgv/pinpoint
jinay 4y ago
I'm beginning to think there's one too many of these kinds of apps, but if anyone is interested in a cross-platform (Mac, Linux, Windows) alternative, I've built a command-palette type interface [1] to GPT that supports code blocks/LaTeX too. [1] https://github.com/JinayJain/gpt-anywhere/releases/latest https://github.com/JinayJain/gpt-anywhere/releases/latest

gitgud 4y ago

Clean UI, loads fast, but there's significant latency when I type a prompt into the text box... probably client state being debounced or something

solumunus 4y ago
This. There is very noticeable latency when typing. This is on a very powerful desktop PC using Chrome. If you hold down a character on your keyboard it shows the issue more clearly, the input will sporadically appear every few seconds.
- Shackles 4y ago
  Okay, this shouldn't happen. Please create a GitHub issue, I'll investigate.

smusamashah 4y ago

There is also https://niek.github.io/chatgpt-web/ https://niek.github.io/chatgpt-web/

dvcrn 4y ago
Heh, I wrote one too (in Elixir + LiveView) - https://github.com/dvcrn/chatgpt-ui https://github.com/dvcrn/chatgpt-ui Background was that we wanted to explore providing access to ChatGPT to employees at $company, but restrict access with Google OAuth using company email, and use the company OpenAI API key on the back. So I hacked together something quick that matches our requirements and we can self-host.
itsuka 4y ago
I just started putting together these Chat API-based UIs in this repo, in case anyone's interested: https://github.com/itsuka-dev/awesome-chatgpt-ui https://github.com/itsuka-dev/awesome-chatgpt-ui

detrites 4y ago

> SlickGPT allows you to run your own local ChatGPT instance No, it doesn't. If it did, it would be a 700GB+ download and not need OpenAI API keys. Wish folks would stop saying it.

Shackles 4y ago
You're right. Fixed wording in our README on Github, can't edit HN post. Thanks
deleted 4y ago
[deleted]
Tepix 4y ago
German press is just as bad: https://www.golem.de/news/ki-auf-dem-intel-8088-entwickler-bringt-chatgpt-auf-ms-dos-zum-laufen-2303-172966.html https://www.golem.de/news/ki-auf-dem-intel-8088-entwickler-b... "Entwickler bringt ChatGPT auf MS-DOS zum Laufen" in English: "Developer gets ChatGPT to run on MS-DOS".
- neuronic 4y ago
  This portion is especially hilarious: "Auf den Entwickler kam allerdings direkt eine weitere Hürde hinzu: MS-DOS integriert nativ keinen Netzwerk-Stack oder eine entsprechende API. Die ist allerdings für den Zugriff auf ChatGPT zwingend notwendig." DeepL: "However, the developer was immediately faced with another hurdle: MS-DOS does not natively integrate a network stack or a corresponding API. However, this is absolutely necessary for accessing ChatGPT." Golem is a very highly frequented German technology website.
throwaway49593 4y ago
ChatGPT is the name of a frontend app/service (albeit a first-party one). The model itself is called gpt-3.5-turbo. I think you're wrong on this one.
- KomoD 4y ago
  > We’ve trained a model called ChatGPT which interacts in a conversational way. > ChatGPT is a sibling model to InstructGPT OpenAI's own words

H8crilA 4y ago

I'm missing the purpose of this.

yreg 4y ago
It seems to me that ChatGPT's history archive is down 98% of the time, so that would be one reason for using a custom web UI.
- moffkalast 4y ago
  Has anyone ever needed that history? I sure haven't. It's like having a copy of every google search and result you ever got, entirely pointless.
  - gremlinsinc 4y ago
    I think it'd be better if you could just 'save' the ones you want to keep, the rest are automatically discarded.
  - taylorfinley 4y ago
    I found it very helpful when writing a blog post series about teaching GPT to translate ROT13-encoded text--instead of documenting each prompt as I went, I could just get into a flow state with the model and try a bunch of things, going back later to pick the moments that gave me an insight.
  - yreg 4y ago
    I needed it many times (and it was often unavailable). When I wanted to continue with previous conversation or refer back to something GPT said. I even experienced it indirectly when I asked someone on reddit about a prompt they have used to make something (generate a pretty good video script) and OP said that they would gladly share it, but unfortunately the history was down. I don't use GPT to get information in a search-engine manner.
  - circuit10 4y ago
    Yes, all the time, it's very frustrating to use it without it

antibasilisk 4y ago

Why?

JoeJonathan 4y ago
I was wondering the same. The HN cheerleading for members of the tribe makes this place feel like a recipe blog. "Looks yum! Can't wait to tryy." 5 stars.