I think there are several reasons why this is a good “crowdsourcing” task:
(a) When you pay for an expensive dedicated host, much of what you’re paying for is the near-100% uptime. With our Circumventor systems (where people have redundant URLs to fall back on if one goes down), you can live with 80% uptime, so the “cost” of the hosting goes way down, to the point where many volunteers host the URLs for free.
(b) Regardless of their talents, almost anyone with a broadband connection has something they can contribute, since most of their bandwidth on any given day is not being used.
(c) In order to get around Internet censorship, you need many nodes running Circumventor-like software, rather than one central server, which can be blocked easily. So not only is the task suited to crowdsourcing, but it would be very hard to run without it.
This task has now been de-listed from Mechanical Turk for nearly a week. Bennett has had little contact from Amazon to correct the problem.
There appear to be a lot of problems with MTurk:
- The first two transfers from my bank account failed and nobody knows why
- When the first two transfers failed from my bank account, I didn’t get an e-mail about it, and I had to log in to find out
- You can’t edit the alloted time, the payment, or the task description for an existing HIT. (Perhaps this is intentional. Obviously after someone has agreed to take on a given HIT, you don’t want to change the parameters on them while they’re in the middle of it. Rather than letting you edit the HIT but having the old payment/description still “frozen” and applied retroactively to people who have already signed up, maybe it’s easier from their point of view just to have you make a new one.)
- If a requester has a tech support question, each answer comes from a “do not reply” address, and if you want to follow up, you have to fill out a new ticket on their site and explain everything from the beginning again
So Bennett, is Mechanical Turk the future?
It seems there are less than 100 HITs available on the entire site. If there are really that few, you’d think they could devote more personal attention to each one.
I love the *idea* of something like Mechanical Turk — that’s probably why the bugs in the implementation are all the more frustrating.