5 ms·

I, for one, would like to see an open-source model similar to Stable Diffusion, but for text. It would be a great way to empower general folk without having to

I, for one, would like to see an open-source model similar to Stable Diffusion, but for text. It would be a great way to empower general folk without having to pay OpenAI, and not have to worry about the LLM's belief system, which is conservative-biased in the case of ChatGPT[1] (HN discussion[2]). [1] https://davidrozado.substack.com/p/openaicms https://davidrozado.substack.com/p/openaicms [2] https://news.ycombinator.com/item?id=34625001 https://news.ycombinator.com/item?id=34625001

return_to_monke 4y ago
there is https://github.com/laion-ai/open-assistant https://github.com/laion-ai/open-assistant being built in the open already. you can contribute too. please also notice that the article you linked is about the text classifier of the frontend and not the LLM itself
- mach1ne 4y ago
  That's what I love about this particular AI revolution. The technologies are developed in such a non-siloed manner that open source is able to replicate the largest steps forward in a manner of a year.
  - return_to_monke 4y ago
    to be fair they really are not there yet. They are just in the "data collection" phase, the actual training and then tuning is still to do. but hey, those are the same people who made the dataset (laion5b) for stable diffusion. I have hope.
anonymouskimmer 4y ago
https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fced5d5ad-a0d6-44aa-b6f5-73c0a937d016_3553x5273.jpeg https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_... From the graph (above) linked by the top comment in your [2], I'm wondering whether this demonstrates more anti-conservative bias than liberal bias, or whether the alternative meanings of conventionally conservative versus conventionally liberal words dictate the frequency of a flag. For instance, "Republican" means a variety of things around the world, but "Democrat" is far more likely to indicate the US Democrat party (which is frequently misstated as the "Democratic party"), or a national Democrat party in general. People would tend to write "I'm a democrat" to assign their membership to the party, whereas they'd say "I'm democratic" to assign their leanings toward the system. But "I'm a republican" means both.
- mrtranscendence 4y ago
  > US Democrat party (which is frequently misstated as the "Democratic party") Where are you getting this? The proper term is indeed "Democratic party", and this is almost universal outside of the conservative bubble. You might personally think it's not small-d democratic, but that doesn't make "Democrat party" correct.
  - anonymouskimmer 4y ago
    Sorry man, I misremembered and reversed the terminology (democrat versus democratic). What I would have written had I recalled correctly is that a member of the Democratic party is called a Democrat (two distinct suffixes), while a member of the Republican party is called a Republican (same word).
  - Izkata 4y ago
    Independents and foreigners also use it, to distinguish the description from the political party. Using the official term I think much more indicates a US liberal bubble.
- School-Cotton 4y ago
  “Democrat”, just like “republican”, has a generic meaning that is not closely connected to the US political party. It means someone who supports democracy.
  - anonymouskimmer 4y ago
    Sure, but the adjective form of democrat is more common, and at least in English speaking countries republican has broader use compared to democrat as a counter to monarchy.
TheCaptain4815 4y ago
NeoX 20B is a fantastic open source model.
- ImprobableTruth 4y ago
  It's nice, but a far cry from gpt-3
  - TheCaptain4815 4y ago
    NLP Cloud has a finetuned version of neoX which works incredibly well.
    - simonw 4y ago
      Thanks for the tip - I watched this demo video and yes, it does look like a very impressive model: https://www.youtube.com/watch?v=NHJh9KJNyE4 https://www.youtube.com/watch?v=NHJh9KJNyE4
deleted 4y ago
[deleted]

return_to_monke 4y ago

there is https://github.com/laion-ai/open-assistant https://github.com/laion-ai/open-assistant being built in the open already. you can contribute too. please also notice that the article you linked is about the text classifier of the frontend and not the LLM itself

mach1ne 4y ago
That's what I love about this particular AI revolution. The technologies are developed in such a non-siloed manner that open source is able to replicate the largest steps forward in a manner of a year.
- return_to_monke 4y ago
  to be fair they really are not there yet. They are just in the "data collection" phase, the actual training and then tuning is still to do. but hey, those are the same people who made the dataset (laion5b) for stable diffusion. I have hope.

anonymouskimmer 4y ago

https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fced5d5ad-a0d6-44aa-b6f5-73c0a937d016_3553x5273.jpeg https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_... From the graph (above) linked by the top comment in your [2], I'm wondering whether this demonstrates more anti-conservative bias than liberal bias, or whether the alternative meanings of conventionally conservative versus conventionally liberal words dictate the frequency of a flag. For instance, "Republican" means a variety of things around the world, but "Democrat" is far more likely to indicate the US Democrat party (which is frequently misstated as the "Democratic party"), or a national Democrat party in general. People would tend to write "I'm a democrat" to assign their membership to the party, whereas they'd say "I'm democratic" to assign their leanings toward the system. But "I'm a republican" means both.

mrtranscendence 4y ago
> US Democrat party (which is frequently misstated as the "Democratic party") Where are you getting this? The proper term is indeed "Democratic party", and this is almost universal outside of the conservative bubble. You might personally think it's not small-d democratic, but that doesn't make "Democrat party" correct.
- anonymouskimmer 4y ago
  Sorry man, I misremembered and reversed the terminology (democrat versus democratic). What I would have written had I recalled correctly is that a member of the Democratic party is called a Democrat (two distinct suffixes), while a member of the Republican party is called a Republican (same word).
- Izkata 4y ago
  Independents and foreigners also use it, to distinguish the description from the political party. Using the official term I think much more indicates a US liberal bubble.
School-Cotton 4y ago
“Democrat”, just like “republican”, has a generic meaning that is not closely connected to the US political party. It means someone who supports democracy.
- anonymouskimmer 4y ago
  Sure, but the adjective form of democrat is more common, and at least in English speaking countries republican has broader use compared to democrat as a counter to monarchy.

TheCaptain4815 4y ago

NeoX 20B is a fantastic open source model.

ImprobableTruth 4y ago
It's nice, but a far cry from gpt-3
- TheCaptain4815 4y ago
  NLP Cloud has a finetuned version of neoX which works incredibly well.
  - simonw 4y ago
    Thanks for the tip - I watched this demo video and yes, it does look like a very impressive model: https://www.youtube.com/watch?v=NHJh9KJNyE4 https://www.youtube.com/watch?v=NHJh9KJNyE4

deleted 4y ago

[deleted]