Each day, Bing discovers 12 billion URLs which you’ve by no means visible before

Microsoft’s Fabrice Canel said that Bing discovers 12 billion normalized URLs every day which have by no means been visible earlier than. That is lots of latest URLs for BingBot to discover in a day, don’t you watched?

however the internet is big, and content material is constantly being produced, not simply exceptional content material, however a variety of rubbish, bullshit, system-generated content material, and so forth.

Fabrice explained further Twitter that most of the content material is “ordinarily useless content material,” he listed examples together with duplicate content material, scraped content, auto-generated content, junk content material, junk content, and extra.

even though Bing might also discover billions and billions of new URLs per day, I doubt it indexes a good deal of it.

right here are the ones tweets:

internet site = ♾. We find out at #bing 12 billion normalized URLs in line with day that we’ve got by no means visible before. Commonly useless content material (replica/scraped/vehicle-generated content material, junk mail, junk, and many others.). See our tips https://t.Co/IKdDkLNs6W inclusive of “things to avoid”

— Fabrice Canel (@facan) August 17, 2022

discussion board dialogue at Twitter.