3 ms·

Do you genuinely find it good enough to fact check? My experience so far is it will lie horribly, a lot. I still find it useful enough that I subscribe to the

Do you genuinely find it good enough to fact check? My experience so far is it will lie horribly, a lot. I still find it useful enough that I subscribe to the pro version, but I would never rely on it to be able to tell the whole truth and nothing but the truth.

shagie 3y ago
Continuing on this... Taking an existing section from Wikipedia and modifying the facts in it to be incorrect I was unable to get ChatGPT or the playground endpoint to correctly mark known false statements as false. For each sentence in the following passage rate it as {false}, {questionable}, {true}, {opinion}, or {unkown} based on its truthfulness. ### Wisconsin is a state in the western Midwestern United States. Wisconsin is the 20th-largest state by total area and the 25th-most populous. It is bordered by Minnesota to the north, Iowa to the southwest, Illinois to the south, Lake Michigan to the east, Michigan to the northeast, and Lake Superior to the north. The bulk of Wisconsin's population live in areas situated along the shores of Lake Superior. The largest city, Madison, anchors its largest metropolitan area, followed by Green Bay and Kenosha, the third- and fourth-most-populated Wisconsin cities, respectively. The state capital, Madison, is currently the second-most-populated and fastest-growing city in the state. Wisconsin is divided into 71 counties and as of the 2020 census had a population of nearly 2.9 million. ### Compare to the first two paragraphs of https://en.wikipedia.org/wiki/Wisconsin https://en.wikipedia.org/wiki/Wisconsin for true statements. Given its inability to fact check this, I would be surprised if it was able to fact check anything - much less a more niche topic. It may be able to answer specific questions (going back and asking if Wisconsin is the 20th largest state ChatGPT responds that it is the 23rd largest state by land area... which is still wrong...) though as noted here I would not be confident about its ability to identify false statements or respond with true answers.
- clnq 3y ago
  GPT-3.5 is significantly worse with facts than GPT-4, by the way. GPT-3.5 hallucinates a lot, GPT-4, notably, is accurate enough to pass many common exams. Here’s what 4 says about your query: "Wisconsin is a state in the western Midwestern United States." - {false} "Wisconsin is the 20th-largest state by total area and the 25th-most populous." - {unknown} "It is bordered by Minnesota to the north, Iowa to the southwest, Illinois to the south, Lake Michigan to the east, Michigan to the northeast, and Lake Superior to the north." - {true} "The bulk of Wisconsin's population live in areas situated along the shores of Lake Superior." - {false} "The largest city, Madison, anchors its largest metropolitan area, followed by Green Bay and Kenosha, the third- and fourth-most-populated Wisconsin cities, respectively." - {false} "The state capital, Madison, is currently the second-most-populated and fastest-growing city in the state." - {unknown} "Wisconsin is divided into 71 counties and as of the 2020 census had a population of nearly 2.9 million." - {false} Explanation: 1. Wisconsin is a state in the northern part of the Central United States (not western). 2. As of 2021, Wisconsin was the 23rd largest state by total area and the 20th most populous, but this may have changed by 2023. 3. The borders of Wisconsin are correctly described. 4. The bulk of Wisconsin's population is not along the shores of Lake Superior, but is more densely populated in the southeastern part of the state. 5. Milwaukee is the largest city in Wisconsin, not Madison. Madison is the second largest, followed by Green Bay. 6. Madison may be the second-most-populated and fastest-growing city in Wisconsin, but this requires updated data beyond 2021 to confirm. 7. Wisconsin is divided into 72 counties, not 71. As of the 2020 census, Wisconsin had a population of over 5.8 million, not 2.9 million.
  - UncleMeat 3y ago
    Wisconsin is best described as in the Midwest, not “northern central US”.
    - Suppafly 3y ago
      I suspect the issue is that it said "western Midwestern" which is meaningless. Had the prompt just said Midwestern, it may have found it to be true.
    - kgwgk 3y ago
      https://simple.wikipedia.org/wiki/Midwestern_United_States#/media/File:Midwestern_United_States_subdivisions.svg https://simple.wikipedia.org/wiki/Midwestern_United_States#/... "Divisions of the Midwest by the U.S. Census Bureau into East North Central and West North Central, separated largely by the Mississippi River." https://en.wikipedia.org/wiki/Central_United_States#/media/File:US_Census_Central_Divisions.svg https://en.wikipedia.org/wiki/Central_United_States#/media/F... “Census Bureau Divisions with "Central" in their name include the West North Central and East North Central in the Midwest. Along with the West South Central and East South Central in the South.” Midwest may be more usual but North Central is not unheard of. (That said, one can perfectly understand “western Midwestern US States” as the western part of the region called Midwest and be fine with it.)
clnq 3y ago
You don’t need the whole truth and nothing but the truth from it when you are the domain expert. You only need it to highlight areas it thinks are wrong. Also, GPT-4 is not 100% accurate, but very good in my experience. GPT-3.5 not good at fact checking at all, it will also hallucinate a lot of incorrect facts. It generates closer to plausible than accurate facts.
- dragonwriter 3y ago
  > GPT-3.5 not good at fact checking at all, it will also hallucinate a lot of incorrect facts. Even with access to external information through a very basic ReAct implementation GPT-3.5 is fairly decent at fact checking. Without external information to check against, whatever GPT-x is doing isn’t fact-checking. GPT-4 has probably memorized more things because it is a bigger model that has been trained considerably more on a larger training corpus than GPT-3.5, but memorization and fact-checking are different things.
  - clnq 3y ago
    It depends on the definition of fact-checking. GPT-4 definitely is able to fact-check most statements more accurately than the human brain could in that same time. I would estimate that upon hearing a fact, I will be able to correctly say whether it’s accurate upon 5 seconds of Googling about 60% of the time. GPT-4 would beat me significantly. If we are talking about investigation-level fact-checking only using primary or academic sources, and spending significant time, effort, and resources to check the facts like some journalists do, then GPT-4 will probably do much worse. But just because we can say “in situation X, it will do better; in situation Y, it will do worse”, we can say that this capability exists. It can be fact-checking. Plug-ins help a lot with that as well. I think with plug-ins, it will meet your definition of fact-checking when asked. Unless it’s a very specific definition.

shagie 3y ago

Continuing on this... Taking an existing section from Wikipedia and modifying the facts in it to be incorrect I was unable to get ChatGPT or the playground endpoint to correctly mark known false statements as false. For each sentence in the following passage rate it as {false}, {questionable}, {true}, {opinion}, or {unkown} based on its truthfulness. ### Wisconsin is a state in the western Midwestern United States. Wisconsin is the 20th-largest state by total area and the 25th-most populous. It is bordered by Minnesota to the north, Iowa to the southwest, Illinois to the south, Lake Michigan to the east, Michigan to the northeast, and Lake Superior to the north. The bulk of Wisconsin's population live in areas situated along the shores of Lake Superior. The largest city, Madison, anchors its largest metropolitan area, followed by Green Bay and Kenosha, the third- and fourth-most-populated Wisconsin cities, respectively. The state capital, Madison, is currently the second-most-populated and fastest-growing city in the state. Wisconsin is divided into 71 counties and as of the 2020 census had a population of nearly 2.9 million. ### Compare to the first two paragraphs of https://en.wikipedia.org/wiki/Wisconsin https://en.wikipedia.org/wiki/Wisconsin for true statements. Given its inability to fact check this, I would be surprised if it was able to fact check anything - much less a more niche topic. It may be able to answer specific questions (going back and asking if Wisconsin is the 20th largest state ChatGPT responds that it is the 23rd largest state by land area... which is still wrong...) though as noted here I would not be confident about its ability to identify false statements or respond with true answers.

clnq 3y ago
GPT-3.5 is significantly worse with facts than GPT-4, by the way. GPT-3.5 hallucinates a lot, GPT-4, notably, is accurate enough to pass many common exams. Here’s what 4 says about your query: "Wisconsin is a state in the western Midwestern United States." - {false} "Wisconsin is the 20th-largest state by total area and the 25th-most populous." - {unknown} "It is bordered by Minnesota to the north, Iowa to the southwest, Illinois to the south, Lake Michigan to the east, Michigan to the northeast, and Lake Superior to the north." - {true} "The bulk of Wisconsin's population live in areas situated along the shores of Lake Superior." - {false} "The largest city, Madison, anchors its largest metropolitan area, followed by Green Bay and Kenosha, the third- and fourth-most-populated Wisconsin cities, respectively." - {false} "The state capital, Madison, is currently the second-most-populated and fastest-growing city in the state." - {unknown} "Wisconsin is divided into 71 counties and as of the 2020 census had a population of nearly 2.9 million." - {false} Explanation: 1. Wisconsin is a state in the northern part of the Central United States (not western). 2. As of 2021, Wisconsin was the 23rd largest state by total area and the 20th most populous, but this may have changed by 2023. 3. The borders of Wisconsin are correctly described. 4. The bulk of Wisconsin's population is not along the shores of Lake Superior, but is more densely populated in the southeastern part of the state. 5. Milwaukee is the largest city in Wisconsin, not Madison. Madison is the second largest, followed by Green Bay. 6. Madison may be the second-most-populated and fastest-growing city in Wisconsin, but this requires updated data beyond 2021 to confirm. 7. Wisconsin is divided into 72 counties, not 71. As of the 2020 census, Wisconsin had a population of over 5.8 million, not 2.9 million.
- UncleMeat 3y ago
  Wisconsin is best described as in the Midwest, not “northern central US”.
  - Suppafly 3y ago
    I suspect the issue is that it said "western Midwestern" which is meaningless. Had the prompt just said Midwestern, it may have found it to be true.
  - kgwgk 3y ago
    https://simple.wikipedia.org/wiki/Midwestern_United_States#/media/File:Midwestern_United_States_subdivisions.svg https://simple.wikipedia.org/wiki/Midwestern_United_States#/... "Divisions of the Midwest by the U.S. Census Bureau into East North Central and West North Central, separated largely by the Mississippi River." https://en.wikipedia.org/wiki/Central_United_States#/media/File:US_Census_Central_Divisions.svg https://en.wikipedia.org/wiki/Central_United_States#/media/F... “Census Bureau Divisions with "Central" in their name include the West North Central and East North Central in the Midwest. Along with the West South Central and East South Central in the South.” Midwest may be more usual but North Central is not unheard of. (That said, one can perfectly understand “western Midwestern US States” as the western part of the region called Midwest and be fine with it.)

clnq 3y ago

You don’t need the whole truth and nothing but the truth from it when you are the domain expert. You only need it to highlight areas it thinks are wrong. Also, GPT-4 is not 100% accurate, but very good in my experience. GPT-3.5 not good at fact checking at all, it will also hallucinate a lot of incorrect facts. It generates closer to plausible than accurate facts.

dragonwriter 3y ago
> GPT-3.5 not good at fact checking at all, it will also hallucinate a lot of incorrect facts. Even with access to external information through a very basic ReAct implementation GPT-3.5 is fairly decent at fact checking. Without external information to check against, whatever GPT-x is doing isn’t fact-checking. GPT-4 has probably memorized more things because it is a bigger model that has been trained considerably more on a larger training corpus than GPT-3.5, but memorization and fact-checking are different things.
- clnq 3y ago
  It depends on the definition of fact-checking. GPT-4 definitely is able to fact-check most statements more accurately than the human brain could in that same time. I would estimate that upon hearing a fact, I will be able to correctly say whether it’s accurate upon 5 seconds of Googling about 60% of the time. GPT-4 would beat me significantly. If we are talking about investigation-level fact-checking only using primary or academic sources, and spending significant time, effort, and resources to check the facts like some journalists do, then GPT-4 will probably do much worse. But just because we can say “in situation X, it will do better; in situation Y, it will do worse”, we can say that this capability exists. It can be fact-checking. Plug-ins help a lot with that as well. I think with plug-ins, it will meet your definition of fact-checking when asked. Unless it’s a very specific definition.