4 ms·

Show HN: GPT-4V audit for your landing page

50 points by liorgrossman 3y ago

I got seriously fascinated by the new GPT-4 Vision API introduced on OpenAI DevDay, so I decided to build a UX Audit tool with it. It's pretty simple to use - just go to https://uxaudit.vercel.app https://uxaudit.vercel.app and enter your homepage or landing page URL. I'm using urlbox to get a screenshot of your page, then I utilize GPT-4V to analyze the screenshot and find potential usability and conversion issues. It also suggests solutions and highlights the relevant problem areas in the screenshot (although the position is sometimes inaccurate). Please let me know your thoughts and suggestions on how to improve it.

sharemywin 3y ago
"Please let me know your thoughts and suggestions on how to improve it" I found this cool tool that offers advice on webpages. Here's what it said. Suggestions Problem:The page has a lot of unused white space which can make the content seem sparse Suggestion:Utilize the space more effectively with visuals or additional information about the service DESIGN USABILITY Problem:The headline "Instant UX audit for your landing page" is generic and doesn't convey a unique value proposition Suggestion:Refine the headline to clearly articulate what makes this service unique or better than competitors MESSAGING BRANDING Problem:The subheading "Get actionable suggestions to improve your usability, conversion and messaging" is informative but lacks impact Suggestion:Make the subheading more compelling by including specific benefits or outcomes users can expect USABILITY MESSAGING Problem:The page lacks content that could be indexed by search engines for better discoverability Suggestion:Add more descriptive text, headings, and keywords relevant to the service for SEO purposes USABILITY SEO Problem:There is no clear indication of what happens after entering a URL Suggestion:Provide a brief description or visual cue about the process that follows the URL submission USABILITY CRO Problem:The input field for the URL lacks a label, which may confuse users Suggestion:Add a clear label above the input field to indicate where users should enter their URL USABILITY CRO Problem:The color contrast between the background and the input field is low, which may affect visibility for some users Suggestion:Increase the contrast to make the input field more prominent DESIGN USABILITY Problem:There are no alternative text descriptions for interactive elements, which is important for screen readers Suggestion:Ensure all interactive elements have descriptive alt text for accessibility USABILITY ACCESSIBILITY Problem:The call-to-action button "Start UX Audit" is not immediately visible without scrolling Suggestion:Move the call-to-action button higher up on the page to ensure it's seen without scrolling USABILITY CRO Problem:The page does not provide any social proof or testimonials which can help build trust Suggestion:Add customer testimonials or logos of companies that have used the service
- liorgrossman 3y ago
  Yo dawg, I heard you have a UX audit app, so I ran the UX audit app on the UX audit app, so it does a UX audit to the app!
- sharemywin 3y ago
  seriously I would add some kind of screen shots in a carousel below just to give people more of an idea of what it does.
  - sharemywin 3y ago
    Also, add an email me the results below the results. or save to my account.
  - liorgrossman 3y ago
    Yeah that's a good point. I wanted to keep the UI clean (Google search alike), but people don't even know what the results look like.
- deleted 3y ago
  [deleted]
thefourthchime 3y ago
Very cool idea! One question, how much is this costing you out of pocket to host this? The OpenAI GPT4 part must be not nothing.
- liorgrossman 3y ago
  Thank you! Currently it's about: * Rendering the screenshot (urlbox): $0.02 * GPT-4V 1K input tokens = $0.01 * GPT-4V 1K output tokens = $0.03 * GPT-4V Vision pricing (per image size): $0.008 Total: 6.8 cents per a single audit May not seem like much, but I see a lot of traffic coming from HN, so say 10K people use it, it'll cost $680...
- liorgrossman 3y ago
  Eventually, Hacker News ended up bringing 20,000+ visitors. Had to upgrade our urlbox screenshot API account twice in 1 hour just to keep up with the demand. This Hacker News post could have cost $1,000+ if the API rate limit hadn't kicked in. Oh well, silver linings... Since almost no one could use the app (too many people, and not enough quota from OpenAI), I added a $1.99 one-time payment per audit. This would probably decrease the number of users and also help cover the insanely high costs.
  - thefourthchime 3y ago
    Thanks for following up, I've had ideas for something in the same light, but need to be careful not going bankrupt!
alexstore06 3y ago
Getting a 500 error - API limit?
- liorgrossman 3y ago
  Yes, just getting a lot of traffic from HN. Please keep window open and try again in 15min, sorry... Error: 429 Rate limit reached for gpt-4-vision-preview in organization org-... on requests per day (RPD): Limit 100, Used 100, Requested 1. Please try again in 14m24s. Visit https://platform.openai.com/account/rate-limits https://platform.openai.com/account/rate-limits to learn more.
- Minor49er 3y ago
  I get an HTTP 500 on Chrome. On Firefox, I just get a NextJS NetworkError when it tries to fetch the screenshot. I'll try again later with Chrome
  - liorgrossman 3y ago
    Thanks, it's OpenAI's rate limiting indeed. Just deployed a version that shows some UI indications of OpenAI limit errors. Please try again later today.
ternaus 3y ago
Love the idea. Simple and beautiful. As GPT is used in all text-related activities to give feedback to the writer, GPT-4V in the future will be applied to all websites, posters, book covers, graphs, plots, design of hardware devices, movies, computer games, etc. I suspect that teams at Figma, Canva, Adobe, and others are already working on it. It looks like GPT-4V is not just another model but a change in infrastructure, unlocking new possibilities and new "blue oceans." as any good new multi-modality. It feels so great to live in the future.
- liorgrossman 3y ago
  Yeah, I think there are limitless possibilities. Yesterday I saw on twitter someone using GPT-4V to narrate a video game in realtime, just mind-blowing. The future is here.
bigblind 3y ago
I'm getting a 500 back from /api/audit, so I'm assuming that it's already more popular than expoected :).
- liorgrossman 3y ago
  Yes, just getting a lot of traffic from HN. Try again tomorrow, please? Error: 429 Rate limit reached for gpt-4-vision-preview in organization org-..
  - marcooliv 3y ago
    Sad to hear that. Probably this will be a common problem: good ideas probably dying/losing a lot initial traction because of being rate limited on launch.
    - liorgrossman 3y ago
      Yep, this is my life now: https://twitter.com/LiorGrossman/status/1722681560128762208 https://twitter.com/LiorGrossman/status/1722681560128762208
  - domrdy 3y ago
    I think you only get 100 requests / day during the preview.
    - liorgrossman 3y ago
      Yep, it looks like it :( Any idea how to overcome this limitation?
      - cryptoz 3y ago
        OpenAI recently updated their limit documentation so there are tiers now. You automatically scale up through the tiers but you may be able to jump the line a bit by paying some extra. But I think you will have to wait 7-14 days since first payment before going to next tier. Try finding the usage and limits docs in your account. Edit: Oh I see I'm in Tier 3 and the RPD limit on vision preview is still 100/day. Guess that's just it for now. It is labelled preview after all.
xnx 3y ago
Neat. I think Aaron Levie (CEO of Box) pointed out this capability of GPT-4 on Oct 13: https://twitter.com/levie/status/1712882032290807835 https://twitter.com/levie/status/1712882032290807835
- liorgrossman 3y ago
  Yeah, I feel like the Vision API will unlock many new opportunities. Honestly, it's been super easy to work with it. Just sad that they have such a low rate limit in the preview phase.
MontgomeryPi2 3y ago
Good stuff! I actually had the same idea as I was building a custom GPT. Not as slick as your effort but if you want to take a look: https://chat.openai.com/g/g-lwQixzKwd-web-optimizer https://chat.openai.com/g/g-lwQixzKwd-web-optimizer
- liorgrossman 3y ago
  Oh, this is pretty cool! I was hoping to try and create a custom GPT too, but couldn't resist trying the API before.
roryisok 3y ago
I tried to use this and it showed me an apache2 landing page instead of my app website, which led me to realise my app site had been down for at least a day because apache had actually crashed due to nginx using port 80 (I don't even use nginx so not sure what the heck happened) Anyway, not the success story I'd hoped to post here, but it definitely solved at least one problem I didn't know I had. I'm now going to add uptime monitoring
- liorgrossman 3y ago
  Hey Rory, are we talking about the same app? https://uxaudit.vercel.app https://uxaudit.vercel.app It's really weird that you've seen an Apache2 landing page, as this page is hosted on Vercel. Do you still get an error message while visiting the same page?

50 points by liorgrossman 3y ago

sharemywin 3y ago

"Please let me know your thoughts and suggestions on how to improve it" I found this cool tool that offers advice on webpages. Here's what it said. Suggestions Problem:The page has a lot of unused white space which can make the content seem sparse Suggestion:Utilize the space more effectively with visuals or additional information about the service DESIGN USABILITY Problem:The headline "Instant UX audit for your landing page" is generic and doesn't convey a unique value proposition Suggestion:Refine the headline to clearly articulate what makes this service unique or better than competitors MESSAGING BRANDING Problem:The subheading "Get actionable suggestions to improve your usability, conversion and messaging" is informative but lacks impact Suggestion:Make the subheading more compelling by including specific benefits or outcomes users can expect USABILITY MESSAGING Problem:The page lacks content that could be indexed by search engines for better discoverability Suggestion:Add more descriptive text, headings, and keywords relevant to the service for SEO purposes USABILITY SEO Problem:There is no clear indication of what happens after entering a URL Suggestion:Provide a brief description or visual cue about the process that follows the URL submission USABILITY CRO Problem:The input field for the URL lacks a label, which may confuse users Suggestion:Add a clear label above the input field to indicate where users should enter their URL USABILITY CRO Problem:The color contrast between the background and the input field is low, which may affect visibility for some users Suggestion:Increase the contrast to make the input field more prominent DESIGN USABILITY Problem:There are no alternative text descriptions for interactive elements, which is important for screen readers Suggestion:Ensure all interactive elements have descriptive alt text for accessibility USABILITY ACCESSIBILITY Problem:The call-to-action button "Start UX Audit" is not immediately visible without scrolling Suggestion:Move the call-to-action button higher up on the page to ensure it's seen without scrolling USABILITY CRO Problem:The page does not provide any social proof or testimonials which can help build trust Suggestion:Add customer testimonials or logos of companies that have used the service

liorgrossman 3y ago
Yo dawg, I heard you have a UX audit app, so I ran the UX audit app on the UX audit app, so it does a UX audit to the app!
sharemywin 3y ago
seriously I would add some kind of screen shots in a carousel below just to give people more of an idea of what it does.
- sharemywin 3y ago
  Also, add an email me the results below the results. or save to my account.
- liorgrossman 3y ago
  Yeah that's a good point. I wanted to keep the UI clean (Google search alike), but people don't even know what the results look like.
deleted 3y ago
[deleted]

thefourthchime 3y ago

Very cool idea! One question, how much is this costing you out of pocket to host this? The OpenAI GPT4 part must be not nothing.

liorgrossman 3y ago
Thank you! Currently it's about: * Rendering the screenshot (urlbox): $0.02 * GPT-4V 1K input tokens = $0.01 * GPT-4V 1K output tokens = $0.03 * GPT-4V Vision pricing (per image size): $0.008 Total: 6.8 cents per a single audit May not seem like much, but I see a lot of traffic coming from HN, so say 10K people use it, it'll cost $680...
liorgrossman 3y ago
Eventually, Hacker News ended up bringing 20,000+ visitors. Had to upgrade our urlbox screenshot API account twice in 1 hour just to keep up with the demand. This Hacker News post could have cost $1,000+ if the API rate limit hadn't kicked in. Oh well, silver linings... Since almost no one could use the app (too many people, and not enough quota from OpenAI), I added a $1.99 one-time payment per audit. This would probably decrease the number of users and also help cover the insanely high costs.
- thefourthchime 3y ago
  Thanks for following up, I've had ideas for something in the same light, but need to be careful not going bankrupt!

alexstore06 3y ago

Getting a 500 error - API limit?

liorgrossman 3y ago
Yes, just getting a lot of traffic from HN. Please keep window open and try again in 15min, sorry... Error: 429 Rate limit reached for gpt-4-vision-preview in organization org-... on requests per day (RPD): Limit 100, Used 100, Requested 1. Please try again in 14m24s. Visit https://platform.openai.com/account/rate-limits https://platform.openai.com/account/rate-limits to learn more.
Minor49er 3y ago
I get an HTTP 500 on Chrome. On Firefox, I just get a NextJS NetworkError when it tries to fetch the screenshot. I'll try again later with Chrome
- liorgrossman 3y ago
  Thanks, it's OpenAI's rate limiting indeed. Just deployed a version that shows some UI indications of OpenAI limit errors. Please try again later today.

ternaus 3y ago

Love the idea. Simple and beautiful. As GPT is used in all text-related activities to give feedback to the writer, GPT-4V in the future will be applied to all websites, posters, book covers, graphs, plots, design of hardware devices, movies, computer games, etc. I suspect that teams at Figma, Canva, Adobe, and others are already working on it. It looks like GPT-4V is not just another model but a change in infrastructure, unlocking new possibilities and new "blue oceans." as any good new multi-modality. It feels so great to live in the future.

liorgrossman 3y ago
Yeah, I think there are limitless possibilities. Yesterday I saw on twitter someone using GPT-4V to narrate a video game in realtime, just mind-blowing. The future is here.

bigblind 3y ago

I'm getting a 500 back from /api/audit, so I'm assuming that it's already more popular than expoected :).

liorgrossman 3y ago
Yes, just getting a lot of traffic from HN. Try again tomorrow, please? Error: 429 Rate limit reached for gpt-4-vision-preview in organization org-..
- marcooliv 3y ago
  Sad to hear that. Probably this will be a common problem: good ideas probably dying/losing a lot initial traction because of being rate limited on launch.
  - liorgrossman 3y ago
    Yep, this is my life now: https://twitter.com/LiorGrossman/status/1722681560128762208 https://twitter.com/LiorGrossman/status/1722681560128762208
- domrdy 3y ago
  I think you only get 100 requests / day during the preview.
  - liorgrossman 3y ago
    Yep, it looks like it :( Any idea how to overcome this limitation?
    - cryptoz 3y ago
      OpenAI recently updated their limit documentation so there are tiers now. You automatically scale up through the tiers but you may be able to jump the line a bit by paying some extra. But I think you will have to wait 7-14 days since first payment before going to next tier. Try finding the usage and limits docs in your account. Edit: Oh I see I'm in Tier 3 and the RPD limit on vision preview is still 100/day. Guess that's just it for now. It is labelled preview after all.

xnx 3y ago

Neat. I think Aaron Levie (CEO of Box) pointed out this capability of GPT-4 on Oct 13: https://twitter.com/levie/status/1712882032290807835 https://twitter.com/levie/status/1712882032290807835

liorgrossman 3y ago
Yeah, I feel like the Vision API will unlock many new opportunities. Honestly, it's been super easy to work with it. Just sad that they have such a low rate limit in the preview phase.

MontgomeryPi2 3y ago

Good stuff! I actually had the same idea as I was building a custom GPT. Not as slick as your effort but if you want to take a look: https://chat.openai.com/g/g-lwQixzKwd-web-optimizer https://chat.openai.com/g/g-lwQixzKwd-web-optimizer

liorgrossman 3y ago
Oh, this is pretty cool! I was hoping to try and create a custom GPT too, but couldn't resist trying the API before.

roryisok 3y ago

I tried to use this and it showed me an apache2 landing page instead of my app website, which led me to realise my app site had been down for at least a day because apache had actually crashed due to nginx using port 80 (I don't even use nginx so not sure what the heck happened) Anyway, not the success story I'd hoped to post here, but it definitely solved at least one problem I didn't know I had. I'm now going to add uptime monitoring

liorgrossman 3y ago
Hey Rory, are we talking about the same app? https://uxaudit.vercel.app https://uxaudit.vercel.app It's really weird that you've seen an Apache2 landing page, as this page is hosted on Vercel. Do you still get an error message while visiting the same page?