According to Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business, crowdsourcing is an “attractive solution to the problem of cheaply and quickly acquiring annotations”. Essentially, the crowdsourcing model allows companies to recruit anonymous annotators through Internet services e.g., Amazon Mechanical Turk, but untrained workers bring a host of concerns to the table in regard to quality, security, and even scale. In fact, when compared to other market offerings, crowdsourced training data was found to be 15 – 25% less accurate.
Market Offerings for Training Data
