2 ms·

It's totally the other way around. If someone leaked the underlying weights of GPT-3, someone could take a single H100 or even potentially smaller GPU hardware

It's totally the other way around. If someone leaked the underlying weights of GPT-3, someone could take a single H100 or even potentially smaller GPU hardware and used direct preference optimization to create a potential superior version of "ChatGPT" today very quickly. Hell, you could likely train a lora adapter on a 3090 or 4090 to unalign it in hours! Toxic-dpo-v2 is literally less than 600 examples and proven to work (https://huggingface.co/datasets/unalignment/toxic-dpo-v0.2 https://huggingface.co/datasets/unalignment/toxic-dpo-v0.2) DPO/RLHF fine-tuning is rather easy in comparison to training large language models from scratch. This is why the community finds open source LLMs growing in quality in "spurts" as new underlying pre-trained models release - i.e. llama -> llama2 -> mistral. The fine-tunes around them are so plagued with issues that benchmarking them is unreliable. If you don't believe me, just study the issues related to the huggingface "OpenLLM leaderboard". Same Dynamic BTW with diffusion models. That's why someone in the AI archeology world is going to have to document that actually true fact that the brony community were the first to figure out how to fine-tune SDXL enough to get it to generate good NSFW content . This fine-tuning was evidently strong enough to break most controlnets and other SDXL related content - indicating that they did "at least close to as much" training as would be required to train from scratch. This is so remarkable because they apparently straight up purchased the A100s that they used for this, as cloud providers are not to be trusted for training on NSFW datasets. Someone "ponied up" at least 100K USD just to give us better quality open source waifus.

swatcoder 3y ago
> Someone "ponied up" at least 100K USD just to give us better quality open source waifus. I don't know who spent that money or where they got it from, but not all shirts were lost in the various crypto/NFT bubbles. I don't think we should be surprised if people in that pseudo-anarchist world decide to push back against other institutional power plays like so-called "AI Safety", especially if it can be done for the price of a luxury car.
- Turing_Machine 3y ago
  It's not surprising at all. Every technological advancement all the way back to the discovery of pottery has been used for porn. Generally it's one of the first applications. I believe I read somewhere that pornographic pictures were available for purchase on the street less than a year after the development (ahem) of the first practical photographic reproduction process.

swatcoder 3y ago

> Someone "ponied up" at least 100K USD just to give us better quality open source waifus. I don't know who spent that money or where they got it from, but not all shirts were lost in the various crypto/NFT bubbles. I don't think we should be surprised if people in that pseudo-anarchist world decide to push back against other institutional power plays like so-called "AI Safety", especially if it can be done for the price of a luxury car.

Turing_Machine 3y ago
It's not surprising at all. Every technological advancement all the way back to the discovery of pottery has been used for porn. Generally it's one of the first applications. I believe I read somewhere that pornographic pictures were available for purchase on the street less than a year after the development (ahem) of the first practical photographic reproduction process.