5 ms·

Pretty cute pelican on a slightly dodgy bicycle: https://tools.simonwillison.net/svg-render#%3Csvg%20viewBox%3D%220%200%20400%20400%22%20xmlns%3D%22http%3A%2F%2

by simonw 1y ago

Pretty cute pelican on a slightly dodgy bicycle: https://tools.simonwillison.net/svg-render#%3Csvg%20viewBox%3D%220%200%20400%20400%22%20xmlns%3D%22http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%22%3E%0A%20%20%3C!--%20Sky%20background%20--%3E%0A%20%20%3Crect%20width%3D%22400%22%20height%3D%22400%22%20fill%3D%22%2387CEEB%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Ground%20--%3E%0A%20%20%3Crect%20y%3D%22300%22%20width%3D%22400%22%20height%3D%22100%22%20fill%3D%22%2390EE90%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Back%20wheel%20--%3E%0A%20%20%3Ccircle%20cx%3D%22100%22%20cy%3D%22300%22%20r%3D%2240%22%20fill%3D%22none%22%20stroke%3D%22%23333%22%20stroke-width%3D%223%22%2F%3E%0A%20%20%3Ccircle%20cx%3D%22100%22%20cy%3D%22300%22%20r%3D%2235%22%20fill%3D%22none%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%22100%22%20y1%3D%22265%22%20x2%3D%22100%22%20y2%3D%22335%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%2265%22%20y1%3D%22300%22%20x2%3D%22135%22%20y2%3D%22300%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%2275%22%20y1%3D%22275%22%20x2%3D%22125%22%20y2%3D%22325%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%2275%22%20y1%3D%22325%22%20x2%3D%22125%22%20y2%3D%22275%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Front%20wheel%20--%3E%0A%20%20%3Ccircle%20cx%3D%22280%22%20cy%3D%22300%22%20r%3D%2240%22%20fill%3D%22none%22%20stroke%3D%22%23333%22%20stroke-width%3D%223%22%2F%3E%0A%20%20%3Ccircle%20cx%3D%22280%22%20cy%3D%22300%22%20r%3D%2235%22%20fill%3D%22none%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%22280%22%20y1%3D%22265%22%20x2%3D%22280%22%20y2%3D%22335%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%22245%22%20y1%3D%22300%22%20x2%3D%22315%22%20y2%3D%22300%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%22255%22%20y1%3D%22275%22%20x2%3D%22305%22%20y2%3D%22325%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%3Cline%20x1%3D%22255%22%20y1%3D%22325%22%20x2%3D%22305%22%20y2%3D%22275%22%20stroke%3D%22%23666%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Frame%20--%3E%0A%20%20%3Cline%20x1%3D%22100%22%20y1%3D%22300%22%20x2%3D%22180%22%20y2%3D%22240%22%20stroke%3D%22%23333%22%20stroke-width%3D%224%22%2F%3E%0A%20%20%3Cline%20x1%3D%22180%22%20y1%3D%22240%22%20x2%3D%22280%22%20y2%3D%22300%22%20stroke%3D%22%23333%22%20stroke-width%3D%224%22%2F%3E%0A%20%20%3Cline%20x1%3D%22100%22%20y1%3D%22300%22%20x2%3D%22160%22%20y2%3D%22280%22%20stroke%3D%22%23333%22%20stroke-width%3D%223%22%2F%3E%0A%20%20%3Cline%20x1%3D%22160%22%20y1%3D%22280%22%20x2%3D%22280%22%20y2%3D%22300%22%20stroke%3D%22%23333%22%20stroke-width%3D%223%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Handlebars%20--%3E%0A%20%20%3Cline%20x1%3D%22280%22%20y1%3D%22300%22%20x2%3D%22280%22%20y2%3D%22250%22%20stroke%3D%22%23333%22%20stroke-width%3D%223%22%2F%3E%0A%20%20%3Cpath%20d%3D%22M%20260%20250%20L%20280%20250%20L%20300%20250%22%20fill%3D%22none%22%20stroke%3D%22%23333%22%20stroke-width%3D%223%22%20stroke-linecap%3D%22round%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Seat%20--%3E%0A%20%20%3Cellipse%20cx%3D%22160%22%20cy%3D%22270%22%20rx%3D%2225%22%20ry%3D%228%22%20fill%3D%22%238B4513%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pedals%20and%20crank%20--%3E%0A%20%20%3Ccircle%20cx%3D%22160%22%20cy%3D%22280%22%20r%3D%223%22%20fill%3D%22%23333%22%2F%3E%0A%20%20%3Cline%20x1%3D%22160%22%20y1%3D%22280%22%20x2%3D%22160%22%20y2%3D%22295%22%20stroke%3D%22%23333%22%20stroke-width%3D%222%22%2F%3E%0A%20%20%3Ccircle%20cx%3D%22160%22%20cy%3D%22295%22%20r%3D%224%22%20fill%3D%22%23666%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20body%20--%3E%0A%20%20%3Cellipse%20cx%3D%22200%22%20cy%3D%22200%22%20rx%3D%2245%22%20ry%3D%2255%22%20fill%3D%22%23F5F5DC%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20neck%20--%3E%0A%20%20%3Cpath%20d%3D%22M%20210%20160%20Q%20220%20140%20225%20110%22%20fill%3D%22none%22%20stroke%3D%22%23F5F5DC%22%20stroke-width%3D%2225%22%20stroke-linecap%3D%22round%22%2F%3E%0A%20%20%3Cpath%20d%3D%22M%20210%20160%20Q%20220%20140%20225%20110%22%20fill%3D%22none%22%20stroke%3D%22%23333%22%20stroke-width%3D%221%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20head%20--%3E%0A%20%20%3Ccircle%20cx%3D%22225%22%20cy%3D%2295%22%20r%3D%2218%22%20fill%3D%22%23F5F5DC%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20eye%20--%3E%0A%20%20%3Ccircle%20cx%3D%22232%22%20cy%3D%2292%22%20r%3D%224%22%20fill%3D%22%23000%22%2F%3E%0A%20%20%3Ccircle%20cx%3D%22233%22%20cy%3D%2291%22%20r%3D%221.5%22%20fill%3D%22%23fff%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20pouch%20(distinctive%20feature)%20--%3E%0A%20%20%3Cellipse%20cx%3D%22220%22%20cy%3D%22105%22%20rx%3D%2220%22%20ry%3D%2212%22%20fill%3D%22%23FFB6C1%22%20opacity%3D%220.7%22%2F%3E%0A%20%20%3Cpath%20d%3D%22M%20205%20110%20Q%20220%20115%20235%20110%22%20fill%3D%22none%22%20stroke%3D%22%23FF69B4%22%20stroke-width%3D%221.5%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20wings%20--%3E%0A%20%20%3Cellipse%20cx%3D%22160%22%20cy%3D%22190%22%20rx%3D%2230%22%20ry%3D%2250%22%20fill%3D%22%23E6E6FA%22%20transform%3D%22rotate(-35%20160%20190)%22%2F%3E%0A%20%20%3Cellipse%20cx%3D%22240%22%20cy%3D%22190%22%20rx%3D%2230%22%20ry%3D%2250%22%20fill%3D%22%23E6E6FA%22%20transform%3D%22rotate(35%20240%20190)%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20tail%20feathers%20--%3E%0A%20%20%3Cpath%20d%3D%22M%20180%20240%20L%20160%20270%20L%20175%20265%22%20fill%3D%22%23D3D3D3%22%2F%3E%0A%20%20%3Cpath%20d%3D%22M%20190%20245%20L%20175%20280%20L%20190%20273%22%20fill%3D%22%23E6E6FA%22%2F%3E%0A%20%20%3Cpath%20d%3D%22M%20200%20246%20L%20200%20285%20L%20210%20275%22%20fill%3D%22%23D3D3D3%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20legs%20--%3E%0A%20%20%3Cline%20x1%3D%22190%22%20y1%3D%22250%22%20x2%3D%22185%22%20y2%3D%22290%22%20stroke%3D%22%23FF8C00%22%20stroke-width%3D%223%22%20stroke-linecap%3D%22round%22%2F%3E%0A%20%20%3Cline%20x1%3D%22210%22%20y1%3D%22250%22%20x2%3D%22215%22%20y2%3D%22290%22%20stroke%3D%22%23FF8C00%22%20stroke-width%3D%223%22%20stroke-linecap%3D%22round%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Pelican%20feet%20on%20pedals%20--%3E%0A%20%20%3Cellipse%20cx%3D%22183%22%20cy%3D%22295%22%20rx%3D%226%22%20ry%3D%224%22%20fill%3D%22%23FF8C00%22%2F%3E%0A%20%20%3Cellipse%20cx%3D%22217%22%20cy%3D%22295%22%20rx%3D%226%22%20ry%3D%224%22%20fill%3D%22%23FF8C00%22%2F%3E%0A%20%20%0A%20%20%3C!--%20Sun%20--%3E%0A%20%20%3Ccircle%20cx%3D%22350%22%20cy%3D%2250%22%20r%3D%2230%22%20fill%3D%22%23FFD700%22%2F%3E%0A%20%20%3Cline%20x1%3D%22350%22%20y1%3D%2210%22%20x2%3D%22350%22%20y2%3D%220%22%20stroke%3D%22%23FFD700%22%20stroke-width%3D%223%22%20stroke-linecap%3D%22round%22%2F%3E%0A%20%20%3Cline%20x1%3D%22390%22%20y1%3D%2250%22%20x2%3D%22402%22%20y2%3D%2250%22%20stroke%3D%22%23FFD700%22%20stroke-width%3D%223%22%20stroke-linecap%3D%22round%22%2F%3E%0A%20%20%3Cline%20x1%3D%22380%22%20y1%3D%2220%22%20x2%3D%22389%22%20y2%3D%2211%22%20stroke%3D%22%23FFD700%22%20stroke-width%3D%223%22%20stroke-linecap%3D%22round%22%2F%3E%0A%3C%2Fsvg%3E%0A https://tools.simonwillison.net/svg-render#%3Csvg%20viewBox%...

bobson381 1y ago
imagine finding the full text of the svg in the library of babel. Great work!
bradgessler 1y ago
I’m surprised none of the frontier model companies have thrown this test in as an Easter egg.
- CjHuber 1y ago
  Because then they would have to admit that they try to game benchmarks
- ahofmann 1y ago
  simonw has other prompts, that are undisclosed. So cheating on this prompt will be catched.
  - beefnugs 1y ago
    What? you and I cant see his "undisclosed" tests... but you better be sure that whatever model he is testing is specifically looking for these tests coming in over the api, or you know, absolutely everything for the cops
    - Legend2440 1y ago
      You are welcome to test it yourself with whatever svg you want. I am quite confident that they are not cheating for his benchmark, it produces about the same quality for other objects. Your cynicism is unwarranted.
- HDThoreaun 1y ago
  All of hacker news(and simons blog) is undoubtedly in the training data for LLMs. If they specifically tried to cheat at this benchmark it would be obvious and they would be called out

5 ms·

Pretty cute pelican on a slightly dodgy bicycle: https://tools.simonwillison.net/svg-render#%3Csvg%20viewBox%3D%220%200%20400%20400%22%20xmlns%3D%22http%3A%2F%2

by simonw 1y ago

bobson381 1y ago
imagine finding the full text of the svg in the library of babel. Great work!
bradgessler 1y ago
I’m surprised none of the frontier model companies have thrown this test in as an Easter egg.
- CjHuber 1y ago
  Because then they would have to admit that they try to game benchmarks
- ahofmann 1y ago
  simonw has other prompts, that are undisclosed. So cheating on this prompt will be catched.
  - beefnugs 1y ago
    What? you and I cant see his "undisclosed" tests... but you better be sure that whatever model he is testing is specifically looking for these tests coming in over the api, or you know, absolutely everything for the cops
    - Legend2440 1y ago
      You are welcome to test it yourself with whatever svg you want. I am quite confident that they are not cheating for his benchmark, it produces about the same quality for other objects. Your cynicism is unwarranted.
- HDThoreaun 1y ago
  All of hacker news(and simons blog) is undoubtedly in the training data for LLMs. If they specifically tried to cheat at this benchmark it would be obvious and they would be called out