Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,179,935 members, 7,909,475 topics. Date: Saturday, 03 August 2024 at 06:28 AM

How It's Feasible To Manually Review All Domains - Programming - Nairaland

Nairaland Forum / Science/Technology / Programming / How It's Feasible To Manually Review All Domains (201 Views)

Navigating The World Of Free And Cheap Domains With Goodhost Online Forum / Get These 6 Cool Domains For N30k / How To Calculate Check Digit Manually Using Modulus Calculation. (2) (3) (4)

(1) (Reply)

How It's Feasible To Manually Review All Domains by Manish703777: 12:59pm On Sep 03, 2021
After watching Nate Buggia a few weeks ago speak about Live's Webmaster Tools, I was struck by his statistic about the number of domains on the web. He suggested that there are 78 million domains. There's certainly room for disagreement about this number—don't forget Google has one trillion web pages wink —but I bet he's in the right ballpark. If that's right, could we manually review all of them?
drow last names
Sure, 78 million domains is big. But not that big. A few months ago while investigating spam, Danny reviewed a fairly randomly chosen 500 domains in a matter of hours. And I think he did a great job of it, too. That's a good foundation, but could we scale that up and review millions of domains?

I see a few challenges here. Probably the biggest challenge I see is just getting this list of Live's 78 million domains. Next you're going to need a lot of manual reviewers. But if you're Live (or some other search engine) you've already got that list, and a large contract labor force. Too bad for the rest of us.
drow last names
I suppose if you're clever you might be able to do this through Alexa's Web Information Service and Amazon Mechanical Turk. Taking a look at the Mechanical Turk pricing, it looks like you could charge one cent for every domain (or maybe each block of a few dozen domains). So we're probably talking about tens or hundreds of thousands of dollars. But that's pocket change for Google. And Google has plenty of remote offices with lots of search quality engineers. In fact, they say, "Google makes use of evaluators in many countries and languages. These evaluators are carefully trained and are asked to evaluate the quality of search results in several different ways."

So let's say a single person can review 1000 domains in a single day. And let's say you've got 1000 reviewers working on this problem. That tells me that 78 days later you've got all the relevant domains on the internet reviewed. That's less than 10% of Google's workforce, less than 2% of Microsoft's Workforce. Of course you could do it with less if you pre-filtered some of those domains, or took longer than three months to do it. If Google, Yahoo!, and Live haven't already done this... well, I can't imagine that they haven't done at least part of this by now.

Visit This: getloadedinthepark

(1) (Reply)

The Pagerank Hierarchy, As Defined By Celebrities / Day Old Birds @affordable Price. / How To Convert Lotus Notes To Outlook

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 14
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.