3 ms·

Definitely. Daily tools include Google analytics, Google search console, mouseflow and SEMRush. Bing Webmaster is surprisingly good.

Minor49er 4y ago
Have you tried Google's Index Coverage report? It may reveal why those pages are not yet crawled, if they are even known about https://support.google.com/webmasters/answer/7440203 https://support.google.com/webmasters/answer/7440203
- brntsllvn 4y ago
  Absolutely. But the reasons are vague at best. The key reason seems to boil down to limited crawl budget simply because we don't have reputation. In which case, we need to rethink if our business has the ability to generate shareable content. It might not.
  - Minor49er 4y ago
    What is the business, if you don't mind me asking?
    - brntsllvn 4y ago
      Aggregated used car listings. CarGraph.com
      - RobSm 4y ago
        People don't care about such content and so does Google.
        brntsllvn 4y ago
        Firstly thank you for your time and effort on our behalf. We're grateful for your generosity. Next, I totally agree we should probably have an internal version of listing info so users stay on our platform versus bouncing and then having to come back. Good insight. I'll talk with the team about richer data as it furthers our SEO goals. I think the idea here would be that better engagement will improve our ranking? Is that correct? The tricky part is getting impressions and clicks but this could help.
        Minor49er 4y ago
        > I think the idea here would be that better engagement will improve our ranking? Is that correct? Absolutely. Rather than performing optimizations for SEO, it would be better at this point to add more to the site. Once that's done, post about it in different places like on Reddit. You should start to see more traffic from both web crawlers and people alike
        brntsllvn 4y ago
        Got it. Really appreciate you taking a look.
        Minor49er 4y ago
        No problem. Good luck in your endeavor!
      - Minor49er 4y ago
        Just trying out a few searches on Google, I'm seeing a pretty decent amount of results from the site. Though the content on the site could be embellished a lot more to get more value out of the pages since the primary focus is clearly just the pricing graphs right now. I noticed that many of the vehicle images didn't load for me. It looks like they're hosted on whatever site they're pulled from. It would be a good idea to save thumbnails of the images that you find so you can serve them locally and include them for every listing Since you're scraping car data too, it might be a good idea to get some basic descriptions for each type of vehicle. You might be able to opt into the Kelley Blue Book Developers program or similar: http://developer.kbb.com/ http://developer.kbb.com/ It would also be good to provide at least some snippets of the descriptions of the vehicles that you're listing. More textual content would give Google something extra to dig into and would keep users from leaving the site and just browsing ebay or Craigslist themselves as often It would be a bigger effort, but having basically a page for each listing locally would be interesting. You could show the original text and posts from the original source. Make the source clear, along with the last time you retrieved the information from it. Then if the original listing gets removed, you could keep it around. Show that it was unlisted or sold, but have a banner at the top that says something like "This listing is no longer available. Click here to look for available [make] [model]s". It could help people to find why one vehicle was cheaper than another (condition, location, etc)
      - deleted 4y ago
        [deleted]

Minor49er 4y ago

Have you tried Google's Index Coverage report? It may reveal why those pages are not yet crawled, if they are even known about https://support.google.com/webmasters/answer/7440203 https://support.google.com/webmasters/answer/7440203

brntsllvn 4y ago
Absolutely. But the reasons are vague at best. The key reason seems to boil down to limited crawl budget simply because we don't have reputation. In which case, we need to rethink if our business has the ability to generate shareable content. It might not.
- Minor49er 4y ago
  What is the business, if you don't mind me asking?
  - brntsllvn 4y ago
    Aggregated used car listings. CarGraph.com
    - RobSm 4y ago
      People don't care about such content and so does Google.
      - brntsllvn 4y ago
        Firstly thank you for your time and effort on our behalf. We're grateful for your generosity. Next, I totally agree we should probably have an internal version of listing info so users stay on our platform versus bouncing and then having to come back. Good insight. I'll talk with the team about richer data as it furthers our SEO goals. I think the idea here would be that better engagement will improve our ranking? Is that correct? The tricky part is getting impressions and clicks but this could help.
        Minor49er 4y ago
        > I think the idea here would be that better engagement will improve our ranking? Is that correct? Absolutely. Rather than performing optimizations for SEO, it would be better at this point to add more to the site. Once that's done, post about it in different places like on Reddit. You should start to see more traffic from both web crawlers and people alike
        brntsllvn 4y ago
        Got it. Really appreciate you taking a look.
        Minor49er 4y ago
        No problem. Good luck in your endeavor!
    - Minor49er 4y ago
      Just trying out a few searches on Google, I'm seeing a pretty decent amount of results from the site. Though the content on the site could be embellished a lot more to get more value out of the pages since the primary focus is clearly just the pricing graphs right now. I noticed that many of the vehicle images didn't load for me. It looks like they're hosted on whatever site they're pulled from. It would be a good idea to save thumbnails of the images that you find so you can serve them locally and include them for every listing Since you're scraping car data too, it might be a good idea to get some basic descriptions for each type of vehicle. You might be able to opt into the Kelley Blue Book Developers program or similar: http://developer.kbb.com/ http://developer.kbb.com/ It would also be good to provide at least some snippets of the descriptions of the vehicles that you're listing. More textual content would give Google something extra to dig into and would keep users from leaving the site and just browsing ebay or Craigslist themselves as often It would be a bigger effort, but having basically a page for each listing locally would be interesting. You could show the original text and posts from the original source. Make the source clear, along with the last time you retrieved the information from it. Then if the original listing gets removed, you could keep it around. Show that it was unlisted or sold, but have a banner at the top that says something like "This listing is no longer available. Click here to look for available [make] [model]s". It could help people to find why one vehicle was cheaper than another (condition, location, etc)
    - deleted 4y ago
      [deleted]