4 ms·

I appreciate this part of the agent instructions: `AESTHETICS ARE VERY IMPORTANT. All apps should LOOK AMAZING and have GREAT FUNCTIONALITY!`

stopachka 5mo ago
Thank you! Yeah, it is surprising how magic words can impact the performance of LLMs
- swyx 5mo ago
  do you actually know or are you just guessing
  - nezaj 5mo ago
    Funny enough we added this in awhile back when it seemed more conclusive that this does matter. But I was curious and just did an adhoc eval. Here's a version with the aesthetic line included https://with-aes.vercel.app/ https://with-aes.vercel.app/ Here's a version without the line https://wo-aes.vercel.app/ https://wo-aes.vercel.app/ Everything else is the same. Will let y'all be the judge which is better. Both where made in one-shot with this prompt: Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages.
    - swyx 5mo ago
      hard to try bc with-aes has a login wall lol
      - nezaj 5mo ago
        Agreed. It is curious how the agent got nudged to add auth in that one. I did another ad-hoc but this time I added "Use guest auth" to the prompt. This way you don't need to enter an email. Full prompt below Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages. Use guest auth Aesthetic version: https://with-aes-guest-auth.vercel.app/ https://with-aes-guest-auth.vercel.app/ Non-aesthetic version: https://wo-aes-guest-auth.vercel.app/ https://wo-aes-guest-auth.vercel.app/ I'd give the edge to the aesthetic one.
reassess_blind 5mo ago
Trump's tweet style might be onto something.
- fuckinpuppers 5mo ago
  I thought the same thing!

stopachka 5mo ago

Thank you! Yeah, it is surprising how magic words can impact the performance of LLMs

swyx 5mo ago
do you actually know or are you just guessing
- nezaj 5mo ago
  Funny enough we added this in awhile back when it seemed more conclusive that this does matter. But I was curious and just did an adhoc eval. Here's a version with the aesthetic line included https://with-aes.vercel.app/ https://with-aes.vercel.app/ Here's a version without the line https://wo-aes.vercel.app/ https://wo-aes.vercel.app/ Everything else is the same. Will let y'all be the judge which is better. Both where made in one-shot with this prompt: Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages.
  - swyx 5mo ago
    hard to try bc with-aes has a login wall lol
    - nezaj 5mo ago
      Agreed. It is curious how the agent got nudged to add auth in that one. I did another ad-hoc but this time I added "Use guest auth" to the prompt. This way you don't need to enter an email. Full prompt below Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages. Use guest auth Aesthetic version: https://with-aes-guest-auth.vercel.app/ https://with-aes-guest-auth.vercel.app/ Non-aesthetic version: https://wo-aes-guest-auth.vercel.app/ https://wo-aes-guest-auth.vercel.app/ I'd give the edge to the aesthetic one.

reassess_blind 5mo ago

Trump's tweet style might be onto something.

fuckinpuppers 5mo ago
I thought the same thing!