7 ms·

Google: "confetti has left the cannon" > No results found for "confetti has left the cannon". I'm amazed that a "stochastic parrot" can come up with such a be

Google: "confetti has left the cannon" > No results found for "confetti has left the cannon". I'm amazed that a "stochastic parrot" can come up with such a beautiful idiom.

barking_biscuit 4y ago
Out of distribution generations are a thing.
- simon83 4y ago
  I understand that all of this is based on some fundamental mathematics, a couple of algorithms here, and some statistical analysis there. And I find it absolutely amazing that we can use all of that knowledge and encode it into something that resembles intelligence. This makes me think if our brains and the concept of intelligence are really as special and mysterious as we assume.
visarga 4y ago
That name aged like milk. First of all, what you said. And second - a parrot can make more parrots without human help, language models can't make GPU chips. Insulting for both LLMs and parrots.
- groestl 4y ago
  > language models can't make GPU chips Not yet. I'm sure somebody is taking a hard look already.
  - dougabug 4y ago
    I would assume some of them can write Verilog code
    - ben_w 4y ago
      Well, I clearly had to try it even though I don't know my verilog from my veri-println. Can someone who does know, rank this? -- Prompt: verilog code for 4 bit binary adder [I'm skipping the English description of the code, this is just the code part of free ChatGPT's response, no cherry picking] module binary_adder(A, B, Cin, S, Cout); input [3:0] A, B; input Cin; output [3:0] S; output Cout; wire C0, C1, C2; // Full adder for bit 0 full_adder FA0(A[0], B[0], Cin, S[0], C0); // Full adder for bit 1 full_adder FA1(A[1], B[1], C0, S[1], C1); // Full adder for bit 2 full_adder FA2(A[2], B[2], C1, S[2], C2); // Full adder for bit 3 full_adder FA3(A[3], B[3], C2, S[3], Cout); endmodule module full_adder(A, B, Cin, S, Cout); input A, B, Cin; output S, Cout; assign S = A ^ B ^ Cin; assign Cout = (A & B) | (A & Cin) | (B & Cin); endmodule
      - tlb 4y ago
        It seems correct, but verbose. GPT-4 gives the more concise and idiomatic: module full_adder(input [3:0] a, input [3:0] b, input cin, output reg [3:0] sum, output reg cout); always @(*) begin {cout, sum} = a + b + cin; end endmodule
        moyix 4y ago
        We found that Codex was pretty bad at Verilog and so we fine-tuned our own models on Verilog code, starting from the SalesForce CodeGen model. The paper will be at DATE: https://arxiv.org/abs/2212.11140 https://arxiv.org/abs/2212.11140 The largest model we trained is here: https://huggingface.co/shailja/fine-tuned-codegen-16B-Verilog https://huggingface.co/shailja/fine-tuned-codegen-16B-Verilo...
- educaysean 4y ago
  Language models exist not in the physical world but digital. A more apt comparison would be if LLMs can compile new (or slightly modified) LLMs, and I believe the answer will soon be (if not already), a resounding yes.
  - visarga 4y ago
    I agree, LLMs can generate the source code for their network, can generate the training data, supervise a model being trained and explain step by step what they do. That's why I specifically said they can't make GPUs, if they could, they would be self replicators. We'd have to consider them alive.
2bitencryption 4y ago
For the curious, here was the conversation I had: ME: What's another saying similar to: "The cat is out of the bag" or "The genie is out of the bottle"? chatgpt: Another similar saying is "the toothpaste is out of the tube." Like the other two expressions, this phrase conveys the idea that something has been revealed or unleashed, and it cannot be undone or put back into its original state. ME: Can you invent a new phrase that has the same meaning, which is completely new? chatgpt: Certainly! Here's a new phrase with a similar meaning: "The confetti has left the cannon." This phrase suggests that once something is out in the open or has happened, it's impossible to reverse or contain it, much like confetti that has been shot out of a cannon during a celebration. ME: What's the name for this kind of expression? Aphorism? Fable? chatgpt: This kind of expression is known as an idiom. Idioms are phrases or expressions with a figurative meaning that is different from their literal meaning. They are commonly used in everyday language to convey a specific message or sentiment in a more colorful or memorable way.
- bilsbie 4y ago
  I don’t understand why people aren’t more impressed with it clearly understanding and then even inventing idioms. That shows some real intelligence.
  - fnordpiglet 4y ago
    It’s because they’re confused in thinking human intelligence isn’t learned stochastic expectation.
    - gary_0 4y ago
      That's how the brain evolved, after all: take incoming input, process according to previous patterns, output a reaction to peripheral nervous system that will enhance survival. The evolutionary purpose of a cortex is to store a statistical model of an animal's environment based on past stimulus. Human intelligence is just a complicated permutation of these initial systemic parameters.
      - 4y ago
flir 4y ago
Could be lifted from another language. Is nice though.
athom 4y ago
Try looking up "pinkie pie party cannon"
tjr 4y ago
Not exactly the same, but from: https://www.instagram.com/p/CQdBiVyh5C2/?hl=en https://www.instagram.com/p/CQdBiVyh5C2/?hl=en Now that the cat is out of the bag, or, should I say the confetti is out of the… can?
- mcbuilder 4y ago
  Is it strange that I think it's more likely that LLMs generalize and synthesize new things out of old patterns instead of just copying a singular example.
  - layer8 4y ago
    It’s plausible that the above quote made it a closer association for GPT to come up with.
malshe 4y ago
Now Google has one search result pointing to your comment :)

Google: "confetti has left the cannon" > No results found for "confetti has left the cannon". I'm amazed that a "stochastic parrot" can come up with such a beautiful idiom.

barking_biscuit 4y ago

Out of distribution generations are a thing.

simon83 4y ago
I understand that all of this is based on some fundamental mathematics, a couple of algorithms here, and some statistical analysis there. And I find it absolutely amazing that we can use all of that knowledge and encode it into something that resembles intelligence. This makes me think if our brains and the concept of intelligence are really as special and mysterious as we assume.

visarga 4y ago

That name aged like milk. First of all, what you said. And second - a parrot can make more parrots without human help, language models can't make GPU chips. Insulting for both LLMs and parrots.

groestl 4y ago
> language models can't make GPU chips Not yet. I'm sure somebody is taking a hard look already.
- dougabug 4y ago
  I would assume some of them can write Verilog code
  - ben_w 4y ago
    Well, I clearly had to try it even though I don't know my verilog from my veri-println. Can someone who does know, rank this? -- Prompt: verilog code for 4 bit binary adder [I'm skipping the English description of the code, this is just the code part of free ChatGPT's response, no cherry picking] module binary_adder(A, B, Cin, S, Cout); input [3:0] A, B; input Cin; output [3:0] S; output Cout; wire C0, C1, C2; // Full adder for bit 0 full_adder FA0(A[0], B[0], Cin, S[0], C0); // Full adder for bit 1 full_adder FA1(A[1], B[1], C0, S[1], C1); // Full adder for bit 2 full_adder FA2(A[2], B[2], C1, S[2], C2); // Full adder for bit 3 full_adder FA3(A[3], B[3], C2, S[3], Cout); endmodule module full_adder(A, B, Cin, S, Cout); input A, B, Cin; output S, Cout; assign S = A ^ B ^ Cin; assign Cout = (A & B) | (A & Cin) | (B & Cin); endmodule
    - tlb 4y ago
      It seems correct, but verbose. GPT-4 gives the more concise and idiomatic: module full_adder(input [3:0] a, input [3:0] b, input cin, output reg [3:0] sum, output reg cout); always @(*) begin {cout, sum} = a + b + cin; end endmodule
      - moyix 4y ago
        We found that Codex was pretty bad at Verilog and so we fine-tuned our own models on Verilog code, starting from the SalesForce CodeGen model. The paper will be at DATE: https://arxiv.org/abs/2212.11140 https://arxiv.org/abs/2212.11140 The largest model we trained is here: https://huggingface.co/shailja/fine-tuned-codegen-16B-Verilog https://huggingface.co/shailja/fine-tuned-codegen-16B-Verilo...
educaysean 4y ago
Language models exist not in the physical world but digital. A more apt comparison would be if LLMs can compile new (or slightly modified) LLMs, and I believe the answer will soon be (if not already), a resounding yes.
- visarga 4y ago
  I agree, LLMs can generate the source code for their network, can generate the training data, supervise a model being trained and explain step by step what they do. That's why I specifically said they can't make GPUs, if they could, they would be self replicators. We'd have to consider them alive.

2bitencryption 4y ago

For the curious, here was the conversation I had: ME: What's another saying similar to: "The cat is out of the bag" or "The genie is out of the bottle"? chatgpt: Another similar saying is "the toothpaste is out of the tube." Like the other two expressions, this phrase conveys the idea that something has been revealed or unleashed, and it cannot be undone or put back into its original state. ME: Can you invent a new phrase that has the same meaning, which is completely new? chatgpt: Certainly! Here's a new phrase with a similar meaning: "The confetti has left the cannon." This phrase suggests that once something is out in the open or has happened, it's impossible to reverse or contain it, much like confetti that has been shot out of a cannon during a celebration. ME: What's the name for this kind of expression? Aphorism? Fable? chatgpt: This kind of expression is known as an idiom. Idioms are phrases or expressions with a figurative meaning that is different from their literal meaning. They are commonly used in everyday language to convey a specific message or sentiment in a more colorful or memorable way.

bilsbie 4y ago
I don’t understand why people aren’t more impressed with it clearly understanding and then even inventing idioms. That shows some real intelligence.
- fnordpiglet 4y ago
  It’s because they’re confused in thinking human intelligence isn’t learned stochastic expectation.
  - gary_0 4y ago
    That's how the brain evolved, after all: take incoming input, process according to previous patterns, output a reaction to peripheral nervous system that will enhance survival. The evolutionary purpose of a cortex is to store a statistical model of an animal's environment based on past stimulus. Human intelligence is just a complicated permutation of these initial systemic parameters.
    - 4y ago

flir 4y ago

Could be lifted from another language. Is nice though.

athom 4y ago

Try looking up "pinkie pie party cannon"

tjr 4y ago

Not exactly the same, but from: https://www.instagram.com/p/CQdBiVyh5C2/?hl=en https://www.instagram.com/p/CQdBiVyh5C2/?hl=en Now that the cat is out of the bag, or, should I say the confetti is out of the… can?

mcbuilder 4y ago
Is it strange that I think it's more likely that LLMs generalize and synthesize new things out of old patterns instead of just copying a singular example.
- layer8 4y ago
  It’s plausible that the above quote made it a closer association for GPT to come up with.

malshe 4y ago

Now Google has one search result pointing to your comment :)