5 ms·

Thankfully the world is already moving on from these neanderthals. Eluther's GPT-J (https://6b.eleuther.ai/ https://6b.eleuther.ai/) isn't QUITE as good as GPT-

Thankfully the world is already moving on from these neanderthals. Eluther's GPT-J (https://6b.eleuther.ai/ https://6b.eleuther.ai/) isn't QUITE as good as GPT-3, but it's getting close, and was, as I understand it, much more efficient to create. This trend will likely continue, and within a year or two GPT-3 will be old news. Considering OpenAI has proved themselves to be vicious liars, greedy soulless fucks and pandering, censorial assholes, obsolescence couldn't happen to a nicer group.

pitched 5y ago
It was the high cost per API call that pulled all the fun out of GPT-3 for me. I hadn’t been following the company at all but believe you based on just that single issue. It looks like GPT-J has open sourced their entire model so I could potentially run it myself for almost-free? If so, that’s going to be much more fun. Thanks for sharing!
- osmarks 5y ago
  It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.
  - pitched 5y ago
    That thought was why I added “almost” right before posting! It’s free to run, just, except for the expensive parts... AWS still rents out GPU power, right? That might be a bit easier to get started with.
  - osmarks 5y ago
    You can rent GPUs from various cloud providers, but those are hilariously expensive too even given datacentre GPU prices.
  - hrfbi 5y ago
    Hottest take in the history of mankind. I think my screen is about to melt. GNU/Linux is not free, it requires a computer to run. Free beer is not free, drinking it requires you to pay for your upkeep to remain alive to be able to drink it.
    - bluesnowmonkey 5y ago
      The comment to which you replied is making a useful point actually. Self hosting is not free in the relevant sense when comparing cost vs a third party API.
    - osmarks 5y ago
      GNU/Linux requires basically the same hardware as the usual alternative (Windows). If you switch from hosted GPT-3 to selfhosted GPT-J you start needing to get and manage all the hardware, which might go underutilized most of the time depending on what your demand looks like, and which requires lots of software optimizations to use maximally effectively. You can use hosted GPT-J, though, a few companies offer that.
- karmasimida 5y ago
  not possible, to run the original gpt3 model, you need at least 8 gpus to just hold all it parameters in memory
Leparamour 5y ago
>Eluther's GPT-J (https://6b.eleuther.ai/ https://6b.eleuther.ai/) Did this website receive HN's "hug-of-death"?
- osmarks 5y ago
  Seems fine, just quite slow, as it says.
- schleck8 5y ago
  no, it's just expensive to run a 6 billion parameter model. the. limiting factor is the hardware
reducesuffering 5y ago
"Be kind. Don't be snarky. Have curious conversation; don't cross-examine. Please don't fulminate. Please don't sneer, including at the rest of the community." https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- option_greek 5y ago
  Too bad OpenAI doesn't allow free use of technology. Otherwise bots like above can be developed more easily.
  - reducesuffering 5y ago
    Again, care to read the literal guideline above? You're blatantly violating it.
- mdp2021 5y ago
  Name checks :) The content is informative (within the poster's partial opinion) and the epithets can just be interpreted as colourful language to lighten up. Is it possible you interpreted it differently? In some cultures that post has the style intentionally used to elicit a warm laughter - styling is legitimate when applied to a valid (promoting "intellectual curiosity") content.
  - SpicyLemonZest 5y ago
    It's difficult to believe that there are cultures where calling people "vicious liars, greedy soulless fucks" is meant to be a light, playful comment.
    - mdp2021 5y ago
      In many Western European areas that language is not necessarily impulsive flaming, but pondered qualifying with selected, honest terms. The «playful» part is in your «light» unstirred pacified soul as you hammer out those heavy descriptive judgements.
deleted 5y ago
[deleted]
poorjohnmacafee 5y ago
They disappeared into their own fantasy land long ago. They announced that investors will have profit caps because their magical AGI will learn how to achieve infinite profit one day. Statements like this must be remembered so that in the future we can point to this era's most ridiculous companies and the people behind them.
deleted 5y ago
[deleted]

pitched 5y ago

It was the high cost per API call that pulled all the fun out of GPT-3 for me. I hadn’t been following the company at all but believe you based on just that single issue. It looks like GPT-J has open sourced their entire model so I could potentially run it myself for almost-free? If so, that’s going to be much more fun. Thanks for sharing!

osmarks 5y ago
It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.
- pitched 5y ago
  That thought was why I added “almost” right before posting! It’s free to run, just, except for the expensive parts... AWS still rents out GPU power, right? That might be a bit easier to get started with.
- osmarks 5y ago
  You can rent GPUs from various cloud providers, but those are hilariously expensive too even given datacentre GPU prices.
- hrfbi 5y ago
  Hottest take in the history of mankind. I think my screen is about to melt. GNU/Linux is not free, it requires a computer to run. Free beer is not free, drinking it requires you to pay for your upkeep to remain alive to be able to drink it.
  - bluesnowmonkey 5y ago
    The comment to which you replied is making a useful point actually. Self hosting is not free in the relevant sense when comparing cost vs a third party API.
  - osmarks 5y ago
    GNU/Linux requires basically the same hardware as the usual alternative (Windows). If you switch from hosted GPT-3 to selfhosted GPT-J you start needing to get and manage all the hardware, which might go underutilized most of the time depending on what your demand looks like, and which requires lots of software optimizations to use maximally effectively. You can use hosted GPT-J, though, a few companies offer that.
karmasimida 5y ago
not possible, to run the original gpt3 model, you need at least 8 gpus to just hold all it parameters in memory

Leparamour 5y ago

>Eluther's GPT-J (https://6b.eleuther.ai/ https://6b.eleuther.ai/) Did this website receive HN's "hug-of-death"?

osmarks 5y ago
Seems fine, just quite slow, as it says.
schleck8 5y ago
no, it's just expensive to run a 6 billion parameter model. the. limiting factor is the hardware

reducesuffering 5y ago

"Be kind. Don't be snarky. Have curious conversation; don't cross-examine. Please don't fulminate. Please don't sneer, including at the rest of the community." https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html

option_greek 5y ago
Too bad OpenAI doesn't allow free use of technology. Otherwise bots like above can be developed more easily.
- reducesuffering 5y ago
  Again, care to read the literal guideline above? You're blatantly violating it.
mdp2021 5y ago
Name checks :) The content is informative (within the poster's partial opinion) and the epithets can just be interpreted as colourful language to lighten up. Is it possible you interpreted it differently? In some cultures that post has the style intentionally used to elicit a warm laughter - styling is legitimate when applied to a valid (promoting "intellectual curiosity") content.
- SpicyLemonZest 5y ago
  It's difficult to believe that there are cultures where calling people "vicious liars, greedy soulless fucks" is meant to be a light, playful comment.
  - mdp2021 5y ago
    In many Western European areas that language is not necessarily impulsive flaming, but pondered qualifying with selected, honest terms. The «playful» part is in your «light» unstirred pacified soul as you hammer out those heavy descriptive judgements.

deleted 5y ago

[deleted]

poorjohnmacafee 5y ago

They disappeared into their own fantasy land long ago. They announced that investors will have profit caps because their magical AGI will learn how to achieve infinite profit one day. Statements like this must be remembered so that in the future we can point to this era's most ridiculous companies and the people behind them.

deleted 5y ago

[deleted]