10 ms·

Much simpler models like word2vec also showed linear embeddings of geography in this way.

• semitones 3y ago
  source?
  • uoaei 3y ago
    It was something like Paris - France + Japan = Tokyo I know that's not a source but you could also just google "word2vec", as I recall most of the explainer blog posts had similar examples.
    • dylan604 3y ago
      So it's good at SAT type questions?
      • uoaei 3y ago
        It's not "good" at anything, it's a set of word embeddings. You have to apply them in some context using a feedforward model of some sort for them to be used in some task.
    • wnoise 3y ago
      That gets "analogies" rather than "spatial awareness" per-se.
      • uoaei 3y ago
        You put quotes around spatial awareness but the commenter being referenced said geography.