3 ms·

Have you seen PrivateGPT. It's quite good and free.

• yoyopa 3y ago
  what hardware do you need for that?
  • drdaeman 3y ago
    Consumer-grade, AFAIK it's GPT4All with LLaMA.
    • EGreg 3y ago
      Link?
      • hoopsman 3y ago
        Presumably https://github.com/imartinez/privateGPT https://github.com/imartinez/privateGPT
    • raffraffraff 3y ago
      That's doesn't really answer the question. Neither does the github "System requirements" section, which I find disappointing. Ideally, it should give minimum memory requirements and rudimentary performance benchmark table for a sample data set, across a handful of setups (eg, Intel CPU, Apple M1, AMD CPU, with/without a bunch of common GPUs). With that information I would know whether or not it's worth my time even trying it out on my laptop. Edit: lol, I went through 2 pages of the issues on the github page and most of them could be avoided by putting this basic information into the system requirements: https://github.com/imartinez/privateGPT/issues/174 https://github.com/imartinez/privateGPT/issues/174 https://github.com/imartinez/privateGPT/issues/179 https://github.com/imartinez/privateGPT/issues/179 https://github.com/imartinez/privateGPT/issues/104 https://github.com/imartinez/privateGPT/issues/104 https://github.com/imartinez/privateGPT/issues/141 https://github.com/imartinez/privateGPT/issues/141 https://github.com/imartinez/privateGPT/issues/282 https://github.com/imartinez/privateGPT/issues/282 https://github.com/imartinez/privateGPT/issues/316 https://github.com/imartinez/privateGPT/issues/316 https://github.com/imartinez/privateGPT/issues/333 https://github.com/imartinez/privateGPT/issues/333 ... And lots more! Some of these people have 128gb memory and 32 cores, and still find it "very slow". Others having memory pool errors. Some of the answers hand-waving at needing "a more better computer" I reckon a lot of these issues could be closed and linked to a single ticket for proper hardware requirements in the readme.
  • qingcharles 3y ago
    It runs (slowly) on my 6 year old i5 laptop.
• mvkel 3y ago
  It's not nearly usable. It's functional in that it spits out a response. Can that response be used for anything useful? No.