4 ms·

> Today all existing API developers with a history of successful payments can access the GPT-4 API with 8K context. We plan to open up access to new developers

> Today all existing API developers with a history of successful payments can access the GPT-4 API with 8K context. We plan to open up access to new developers by the end of this month, and then start raising rate-limits after that depending on compute availability. Same for me. I signed up only a few days ago and was excited to switch to "gpt-4" but I haven't paid the first bill (save the $5 capture) so I probably have to continue to wait for this. I made a very simple command-line tool that calls the API. You run something like: > ask "What's the opposite of false?" https://github.com/codazoda/askai https://github.com/codazoda/askai

stavros 3y ago
Interesting, I did exactly the same (with the same name), but with GPT-4 support as well: https://www.pastery.net/ccvjrh/ https://www.pastery.net/ccvjrh/ It also does streaming, so it live-prints the response as it comes.
- JimDabell 3y ago
  The llm command-line tool looks great: https://llm.datasette.io/en/stable/ https://llm.datasette.io/en/stable/
  - stavros 3y ago
    It does, thanks for this! I didn't know about it.
  - ftxbro 3y ago
    are we out here typing our api keys into random pips and am i a boomer that i would be hesitant to do it
    - JimDabell 3y ago
      It’s not a “random pip”. The maintainer is a well-known open source developer (one of the creators of Django and Datasette). It’s also a very small codebase – not many places for malicious code to hide.
      - ftxbro 3y ago
        OK but I mean I don't know them and it could have been someone pretending to be them, and probably it's easily possible to trick me about API keys. We are discussing it on a hacker news website do you seriously think tricks couldn't be hidden in a repo like that.
        bestcoder69 3y ago
        https://github.com/search?q=repo%3Asimonw%2Fllm%20OPENAI_API_KEY&type=code https://github.com/search?q=repo%3Asimonw%2Fllm%20OPENAI_API... Let us know what you find.
        ftxbro 3y ago
        I found a few github issues related to api key security and management. I'm not 100% sure of your point.
        jabradoodle 3y ago
        I see no open issues. It's around 1k lines of python, audit the code if you care and rotate your keys. Or don't use it.
        JimDabell 3y ago
        Do you only use software by people you know? At some point there has to be an element of trust when you run software you downloaded over the Internet. If a small utility maintained by a well-known member of the developer community doesn’t qualify for that trust, then I think that rules out an awful lot of software that all of us here probably use on a day to day basis. This is not an extraordinary level of risk.
        ftxbro 3y ago
        > "well-known member of the developer community" OK sorry I didn't know them. I mean I usually use software that came with my computer or ones that I apt-install from the official ubuntu distribution. I know it's not perfect security but at least it's more than a hacker news link to a github pip. If I had to use other ones then it's usually from people I know.
fnordpiglet 3y ago
So, I've been a paying customers for a while now and don't see it either :-(

stavros 3y ago

Interesting, I did exactly the same (with the same name), but with GPT-4 support as well: https://www.pastery.net/ccvjrh/ https://www.pastery.net/ccvjrh/ It also does streaming, so it live-prints the response as it comes.

JimDabell 3y ago
The llm command-line tool looks great: https://llm.datasette.io/en/stable/ https://llm.datasette.io/en/stable/
- stavros 3y ago
  It does, thanks for this! I didn't know about it.
- ftxbro 3y ago
  are we out here typing our api keys into random pips and am i a boomer that i would be hesitant to do it
  - JimDabell 3y ago
    It’s not a “random pip”. The maintainer is a well-known open source developer (one of the creators of Django and Datasette). It’s also a very small codebase – not many places for malicious code to hide.
    - ftxbro 3y ago
      OK but I mean I don't know them and it could have been someone pretending to be them, and probably it's easily possible to trick me about API keys. We are discussing it on a hacker news website do you seriously think tricks couldn't be hidden in a repo like that.
      - bestcoder69 3y ago
        https://github.com/search?q=repo%3Asimonw%2Fllm%20OPENAI_API_KEY&type=code https://github.com/search?q=repo%3Asimonw%2Fllm%20OPENAI_API... Let us know what you find.
        ftxbro 3y ago
        I found a few github issues related to api key security and management. I'm not 100% sure of your point.
        jabradoodle 3y ago
        I see no open issues. It's around 1k lines of python, audit the code if you care and rotate your keys. Or don't use it.
      - JimDabell 3y ago
        Do you only use software by people you know? At some point there has to be an element of trust when you run software you downloaded over the Internet. If a small utility maintained by a well-known member of the developer community doesn’t qualify for that trust, then I think that rules out an awful lot of software that all of us here probably use on a day to day basis. This is not an extraordinary level of risk.
        ftxbro 3y ago
        > "well-known member of the developer community" OK sorry I didn't know them. I mean I usually use software that came with my computer or ones that I apt-install from the official ubuntu distribution. I know it's not perfect security but at least it's more than a hacker news link to a github pip. If I had to use other ones then it's usually from people I know.

fnordpiglet 3y ago

So, I've been a paying customers for a while now and don't see it either :-(