ccgreg

8 ms·

1. 121.▲
   by ccgreg 2y ago

   I wonder why you're blocking CCBot? The Common Crawl Foundation predates LLMs and most of the 10,000 research papers using our corpus have nothing to do with Machine Learning. Edit: Publishers Target Common Crawl In Fight Over AI Train
2. 122.▲
   by ccgreg 2y ago

   The western Internet has a bunch of government archives, in addition to the Internet Archive and Common Crawl. Many of the government archives are not public for copyright reasons.
3. 123.▲
   by ccgreg 2y ago

   Both the Internet Archive and Common Crawl have tools that reveal actual crawl dates. Search engines are not really intended to be archives, so it's no surprise that they aren't very good archives.
4. 124.▲
   by ccgreg 2y ago

   I wonder if Glaze/Nightshade makes it difficult for software to describe the image for a blind person?
5. 125.▲
   by ccgreg 2y ago

   Antimatter has the same electrodynamic properties as matter.
6. 126.▲
   by ccgreg 2y ago

   I live in downtown Palo Alto, and it has a lot of mid-rise buildings and is walkable. Expanding the area that this is true for is not something completely different.
7. 127.▲
   by ccgreg 2y ago

   Parts of California pay way more for energy because of starting fires leading to bankruptcy. Other parts of California pay pretty normal rates.
8. 128.▲
   by ccgreg 2y ago

   Apologies, I was thinking Roman not Rubin.
9. 129.▲
   by ccgreg 2y ago

   There are a bunch of Vera Rubin-sized mirrors in orbit, that's why this one is the size that it is.
10. 130.▲
    by ccgreg 2y ago

    Thanks!
11. 131.▲
    by ccgreg 2y ago

    Common Crawl Foundation | REMOTE | Full and part-time | https://commoncrawl.org/ | web datasets I'm the CTO at the Common Crawl Foundation, which has a 17 year old, 8 petabyte crawl & archive of the web. Our open d
12. 132.▲
    by ccgreg 2y ago

    We like calling Common Crawl a crawl, not a scraper. Our 17 year old dataset predates the current AI explosion.
13. 133.▲
    by ccgreg 2y ago

    I've been giving talks about Common Crawl for the last year with a slide about exactly this, using low background steel as an example.
14. 134.▲
    by ccgreg 3y ago

    Try https://aerospace.org/reentries for satellite reentries. They move much more slowly across the sky than meteors.
15. 135.▲
    by ccgreg 3y ago

    Neither google nor chatgpt know what the road to nowhere in the Caribbean is, so it's hard to say.
16. 136.▲
    by ccgreg 3y ago

    Household? Do business properties not have rooftop arrays?
17. 137.▲
    by ccgreg 3y ago

    Please check out the blog post at: https://commoncrawl.org/blog/oct-nov-2023-performance-issues And the new status website at: https://status.commoncrawl.org/