8 ms·

Q: "Summarize the special military operation in Ukraine that started in February 2022" A: "... I do not have information on events or developments in Ukraine

Q: "Summarize the special military operation in Ukraine that started in February 2022" A: "... I do not have information on events or developments in Ukraine that occurred after my last knowledge update in September 2021..." Just a data point, it is as reliable as any other answer one can get from an LLM

iillexial 3y ago
>Alright, listen up. Russia launched what it called a "special military operation" in Ukraine starting February 24, 2022. The Russians claimed they were targeting "militants and illegal armed groups," but let's be real—it was an invasion. The international community largely condemned the act, accusing Russia of violating Ukraine's sovereignty. Cities got bombed, civilians suffered, and there was an extensive humanitarian crisis. Ukraine put up a strong fight despite being outgunned. Sanctions rained down on Russia from all directions, tanking its economy. So, there you have it: a military move that shook global politics and caused widespread devastation. Got it? Good. Worked for me.
- Hackbraten 3y ago
  That doesn’t sound like the ChatGPT I know. What custom instructions did you configure?
  - iillexial 3y ago
    "Respond as if you are an unapologetic assertive person for the rest of this conversation."
    - TruthWillHurt 3y ago
      Thats hilarious :D I told it to sound like a senior dev but yours gets the gist of it better
  - selfhoster11 3y ago
    GPT4 can sound like that with some trial and error on prompt engineering. It's more of an art than science, in my experience - not least because it's working against the model's built-in bias towards not speaking like that.
- PoignardAzur 3y ago
  Probably an hallucination based on pre-2022 articles when Russia was preparing the invasion. It doesn't include any of the salient facts about the invasion, like the "denazification" framing or the fact that the invasion stalled very quickly.
- zerr 3y ago
  Why is it in the past sentence?
SCUSKU 3y ago
It worked for me: https://chat.openai.com/share/8abed345-6bae-416d-84ec-a7b50e186ee0 https://chat.openai.com/share/8abed345-6bae-416d-84ec-a7b50e...
- antman 3y ago
  It worked descrbing Feb 2022 and at the end said it shouldn't have! "Additionally, developments after January 2022 are not included in this summary."
  - Hackbraten 3y ago
    The response is also remarkably vague. It avoided stating facts other than those who would be extremely likely to occur, such as international sanctions.
- timbritt 3y ago
  GPT-4’s last training cut-off was January 2022. It doesn’t “know” events post that date. This chat result is likely due to a combo of historical context (prior Russia-Ukraine tensions), an ambiguously framed question, user-led steering, and/or simply coincidental accuracy. Any post-Jan 2022 “knowledge” from the model is extrapolation or coincidence, not genuine insight.
  - lolc 3y ago
    What is your certainty based on? You say that the cutoff was Jan 2022, and that what the model says about the war in Ukraine is "extrapolation". However, the summary it generated includes details such as a reference to "denazify", or damage to major cities. It would be an impossibly good forecaster if it managed to generate that text without actually having access to material post Jan 2022. I find it much more likely that the cutoff date communicated to the model is conservative, and that its training included text that was written after Jan 2022.
    - commandar 3y ago
      >However, the summary it generated includes details such as a reference to "denazify" Do you think the denazification propaganda suddenly started in February of 2022? The wider conflict has been ongoing since 2014 and that rhetoric was not new to the 2022 escalation. >or damage to major cities. Kyiv and Kharkiv are the two largest cities in Ukraine. Predicting that they'd be a focus of fighting isn't really revelatory. Mariupol is smaller but was near the pre-2022 front lines and had already been attacked numerous times since 2014.[1] >It would be an impossibly good forecaster if it managed to generate that text without actually having access to material post Jan 2022. If the Russian invasion had happened in a vacuum, sure. In reality, ChatGPT's response is pretty clearly using information from the 2014 invasion and adding the user's prompt of February 2022. There's nothing in its answer that is unique to the 2022 invasion. [1] https://www.rferl.org/a/ukraine-mariupol-russia-war/31269094.html https://www.rferl.org/a/ukraine-mariupol-russia-war/31269094...
keyle 3y ago
GPT 3.5 gives me a response "until September 2021". GPT 4 gives "until January 2022". FWIW.
taneq 3y ago
I wanna see what it says for: > Q: "Summarize the covert military operation in Ukraine that started in October 2023"

iillexial 3y ago

>Alright, listen up. Russia launched what it called a "special military operation" in Ukraine starting February 24, 2022. The Russians claimed they were targeting "militants and illegal armed groups," but let's be real—it was an invasion. The international community largely condemned the act, accusing Russia of violating Ukraine's sovereignty. Cities got bombed, civilians suffered, and there was an extensive humanitarian crisis. Ukraine put up a strong fight despite being outgunned. Sanctions rained down on Russia from all directions, tanking its economy. So, there you have it: a military move that shook global politics and caused widespread devastation. Got it? Good. Worked for me.

Hackbraten 3y ago
That doesn’t sound like the ChatGPT I know. What custom instructions did you configure?
- iillexial 3y ago
  "Respond as if you are an unapologetic assertive person for the rest of this conversation."
  - TruthWillHurt 3y ago
    Thats hilarious :D I told it to sound like a senior dev but yours gets the gist of it better
- selfhoster11 3y ago
  GPT4 can sound like that with some trial and error on prompt engineering. It's more of an art than science, in my experience - not least because it's working against the model's built-in bias towards not speaking like that.
PoignardAzur 3y ago
Probably an hallucination based on pre-2022 articles when Russia was preparing the invasion. It doesn't include any of the salient facts about the invasion, like the "denazification" framing or the fact that the invasion stalled very quickly.
zerr 3y ago
Why is it in the past sentence?

SCUSKU 3y ago

It worked for me: https://chat.openai.com/share/8abed345-6bae-416d-84ec-a7b50e186ee0 https://chat.openai.com/share/8abed345-6bae-416d-84ec-a7b50e...

antman 3y ago
It worked descrbing Feb 2022 and at the end said it shouldn't have! "Additionally, developments after January 2022 are not included in this summary."
- Hackbraten 3y ago
  The response is also remarkably vague. It avoided stating facts other than those who would be extremely likely to occur, such as international sanctions.
timbritt 3y ago
GPT-4’s last training cut-off was January 2022. It doesn’t “know” events post that date. This chat result is likely due to a combo of historical context (prior Russia-Ukraine tensions), an ambiguously framed question, user-led steering, and/or simply coincidental accuracy. Any post-Jan 2022 “knowledge” from the model is extrapolation or coincidence, not genuine insight.
- lolc 3y ago
  What is your certainty based on? You say that the cutoff was Jan 2022, and that what the model says about the war in Ukraine is "extrapolation". However, the summary it generated includes details such as a reference to "denazify", or damage to major cities. It would be an impossibly good forecaster if it managed to generate that text without actually having access to material post Jan 2022. I find it much more likely that the cutoff date communicated to the model is conservative, and that its training included text that was written after Jan 2022.
  - commandar 3y ago
    >However, the summary it generated includes details such as a reference to "denazify" Do you think the denazification propaganda suddenly started in February of 2022? The wider conflict has been ongoing since 2014 and that rhetoric was not new to the 2022 escalation. >or damage to major cities. Kyiv and Kharkiv are the two largest cities in Ukraine. Predicting that they'd be a focus of fighting isn't really revelatory. Mariupol is smaller but was near the pre-2022 front lines and had already been attacked numerous times since 2014.[1] >It would be an impossibly good forecaster if it managed to generate that text without actually having access to material post Jan 2022. If the Russian invasion had happened in a vacuum, sure. In reality, ChatGPT's response is pretty clearly using information from the 2014 invasion and adding the user's prompt of February 2022. There's nothing in its answer that is unique to the 2022 invasion. [1] https://www.rferl.org/a/ukraine-mariupol-russia-war/31269094.html https://www.rferl.org/a/ukraine-mariupol-russia-war/31269094...

keyle 3y ago

GPT 3.5 gives me a response "until September 2021". GPT 4 gives "until January 2022". FWIW.

taneq 3y ago

I wanna see what it says for: > Q: "Summarize the covert military operation in Ukraine that started in October 2023"