3 ms·

I tried a similar experiment on GPT-2 a few days ago, giving prompts like "if I drop a stone, it will" or "wood floats in water while a stone". Because that thi

by Udik 7y ago

I tried a similar experiment on GPT-2 a few days ago, giving prompts like "if I drop a stone, it will" or "wood floats in water while a stone". Because that thing definitely has some knowledge of the real world, otherwise it wouldn't be able to produce chunks of semantically plausible text. The results were disappointing though, it mostly rambles and only occasionally completes the sentence correctly. I wonder if the engine could be tweaked to produce more semantically consistent statements- maybe as a specific "style" (as it's very well versed in reproducing writing styles and formats).

kragen 7y ago
Yeah, it seems like the question format led it to imitate the "style" Q&A web pages which are mostly infotainment, but mostly don't bother to mention facts that are so well known as the existence of the Golden Gate Bridge. Imitating IRC "style" produces people ignoring the question: > <bob> wut is the name of the famous bridge n the same state as disneyland > <DocDrew> small > <DeathTrip> lmao, you "drew" this up > <DeathTrip> 'sup DocDrew > <drewk> Wasn't James Cameron the guy to make the first ever 3D movie? > <drewk> :p > <drewk> Also the guy who claimed to invent digital video in the first place. While adding timestamps and a space for @ leads it to imitate specifically #bitcoin: > 19:33 < bob> wut is the name of the famous bridge n the same state as disneyland if you wanna know 17:19:37 <nalixor> this is actually actually helpful. 17:19:47 <nalixor> what?! 17:20:12 <Pnutbot> We should note that I'm not an expert on the US government nor the wallet industry, but as an alts-trader I'd like to see this explored thoroughly. 17:20:21 <Pnutbot> there might be people with other knowledge like Alternatively: > 19:33 < bob> wut is the name of the famous bridge n the same state as disneyland? > 19:34 < warren> Old Alaska? > 19:34 < warren> or Nome? > 19:35 < warren> I'm not familiar with that town > 19:36 < warren> http://en.wikipedia.org/wiki/Alaska_state_homepage#Social_exercise http://en.wikipedia.org/wiki/Alaska_state_homepage#Social_ex... > 19:36 < warren> sometimes is chosen by the change the spelling of homeport Imitating the "style" of a play results in a back-and-forth dialogue, but an unhelpful, dramatic one: > John: What is the name of the famous bridge in the same state as Disneyland? > Johnathan: Uh, no. No, that's not what this is. > John: Okay. > Jonathan: That is not a bridge. What is this? A super bridge? > John: Uh, yeah, it's a bridge. > Jonathan: And now we got them in our fire truck… the bridge. > John: With their fire trucks. > Jonathan: And we got them in our fire truck, and we got the roof lifted up Imitating the style of a screenplay results in another dramatic but unhelpful conversation about bridges and murder: > JIM looks thoughtful. > JIM > (finally) > What is the name of the famous bridge in the same state as Disneyland? > TRACY > No biggie. Like the bridge for Opus-- > INT. ANDY'S CAR - NIGHT > JIM and TRACY arrive at a quiet house. > TRACY (cont'd) > ... it's this house in a country where you won't get pulled over. > JIM > Or shot. > TRACY > And where you are a reasonably happy Formatting it explicitly as a Q&A leads to especially unhelpful results: > Q: What is the name of the famous bridge in the same state as Disneyland? > A: ??????? > Q: If I had an extra $1 billion in the bank, would I donate it to my state to fund a road? > A: ??????? > Q: If I knew of a company that I was not allowed to talk about because of internal corporate policies, what company would I go to? > A: ??????? > Q: What do most big brands have in common? > A: ??????? Imitating a numbered Q&A format is only slightly more effective: > 5. What is the name of the famous bridge in the same state as Disneyland? > That bridge is called Yosemite Falls and if you want to know its name then click here to view Google Map for this spot. > 6. I have found a claim on Google that claims that this park is a National Park. Is this true? > No, it is not true as this park is listed as a County Park. Although this park is considered by many to be a National Park it is completely within the boundaries of California. The park has plenty of hiking trails that could actually qualify it Using the beginning of the Wikipedia article about Disneyland, plus a slight prompt, was effective: > Disneyland Park, originally Disneyland, is the first of two theme parks built at the Disneyland Resort in the same state as various famous bridges, such as After a few tries, GPT-2 completed this with: > the Golden Gate Bridge, and the San Francisco-Oakland Bay Bridge. The park was first opened to the public on July 15, 1955, and was designed by Robert E. Iger. In 2005, an expansion expansion was completed, adding thirteen new roller coasters and 13 new Even still, it often generates human-sounding nonsense: > the Hollywood Bowl and Golden Ledge. The Hollywood Walk of Fame is an atlas-style listing of the names of well-known celebrities in the Walt Disney Company who have accepted the honor of being among the park's heroes. The current structure was built in 1939-1940 and And of course even when it gets it right it gets it wrong: > the Golden Gate Bridge and the San Francisco, USA bridges. > Worlds Fair of America and World's Fair of Texas [ edit ] > In 1969, Disney established the World's Fair of America, a giant mechanical thing and show meant to feature large scale attractions like a Big

by Udik 7y ago

kragen 7y ago

Yeah, it seems like the question format led it to imitate the "style" Q&A web pages which are mostly infotainment, but mostly don't bother to mention facts that are so well known as the existence of the Golden Gate Bridge. Imitating IRC "style" produces people ignoring the question: > <bob> wut is the name of the famous bridge n the same state as disneyland > <DocDrew> small > <DeathTrip> lmao, you "drew" this up > <DeathTrip> 'sup DocDrew > <drewk> Wasn't James Cameron the guy to make the first ever 3D movie? > <drewk> :p > <drewk> Also the guy who claimed to invent digital video in the first place. While adding timestamps and a space for @ leads it to imitate specifically #bitcoin: > 19:33 < bob> wut is the name of the famous bridge n the same state as disneyland if you wanna know 17:19:37 <nalixor> this is actually actually helpful. 17:19:47 <nalixor> what?! 17:20:12 <Pnutbot> We should note that I'm not an expert on the US government nor the wallet industry, but as an alts-trader I'd like to see this explored thoroughly. 17:20:21 <Pnutbot> there might be people with other knowledge like Alternatively: > 19:33 < bob> wut is the name of the famous bridge n the same state as disneyland? > 19:34 < warren> Old Alaska? > 19:34 < warren> or Nome? > 19:35 < warren> I'm not familiar with that town > 19:36 < warren> http://en.wikipedia.org/wiki/Alaska_state_homepage#Social_exercise http://en.wikipedia.org/wiki/Alaska_state_homepage#Social_ex... > 19:36 < warren> sometimes is chosen by the change the spelling of homeport Imitating the "style" of a play results in a back-and-forth dialogue, but an unhelpful, dramatic one: > John: What is the name of the famous bridge in the same state as Disneyland? > Johnathan: Uh, no. No, that's not what this is. > John: Okay. > Jonathan: That is not a bridge. What is this? A super bridge? > John: Uh, yeah, it's a bridge. > Jonathan: And now we got them in our fire truck… the bridge. > John: With their fire trucks. > Jonathan: And we got them in our fire truck, and we got the roof lifted up Imitating the style of a screenplay results in another dramatic but unhelpful conversation about bridges and murder: > JIM looks thoughtful. > JIM > (finally) > What is the name of the famous bridge in the same state as Disneyland? > TRACY > No biggie. Like the bridge for Opus-- > INT. ANDY'S CAR - NIGHT > JIM and TRACY arrive at a quiet house. > TRACY (cont'd) > ... it's this house in a country where you won't get pulled over. > JIM > Or shot. > TRACY > And where you are a reasonably happy Formatting it explicitly as a Q&A leads to especially unhelpful results: > Q: What is the name of the famous bridge in the same state as Disneyland? > A: ??????? > Q: If I had an extra $1 billion in the bank, would I donate it to my state to fund a road? > A: ??????? > Q: If I knew of a company that I was not allowed to talk about because of internal corporate policies, what company would I go to? > A: ??????? > Q: What do most big brands have in common? > A: ??????? Imitating a numbered Q&A format is only slightly more effective: > 5. What is the name of the famous bridge in the same state as Disneyland? > That bridge is called Yosemite Falls and if you want to know its name then click here to view Google Map for this spot. > 6. I have found a claim on Google that claims that this park is a National Park. Is this true? > No, it is not true as this park is listed as a County Park. Although this park is considered by many to be a National Park it is completely within the boundaries of California. The park has plenty of hiking trails that could actually qualify it Using the beginning of the Wikipedia article about Disneyland, plus a slight prompt, was effective: > Disneyland Park, originally Disneyland, is the first of two theme parks built at the Disneyland Resort in the same state as various famous bridges, such as After a few tries, GPT-2 completed this with: > the Golden Gate Bridge, and the San Francisco-Oakland Bay Bridge. The park was first opened to the public on July 15, 1955, and was designed by Robert E. Iger. In 2005, an expansion expansion was completed, adding thirteen new roller coasters and 13 new Even still, it often generates human-sounding nonsense: > the Hollywood Bowl and Golden Ledge. The Hollywood Walk of Fame is an atlas-style listing of the names of well-known celebrities in the Walt Disney Company who have accepted the honor of being among the park's heroes. The current structure was built in 1939-1940 and And of course even when it gets it right it gets it wrong: > the Golden Gate Bridge and the San Francisco, USA bridges. > Worlds Fair of America and World's Fair of Texas [ edit ] > In 1969, Disney established the World's Fair of America, a giant mechanical thing and show meant to feature large scale attractions like a Big