How does it work?

We use a web crawler written in python to gather all avaliable information from Amazon Mechanical Turk, we store that information PostgreSQL and everything is working on Amazon EC2 instances. We crawl Mechanical Turk each hour, and compute daily statistics for new projects and completed tasks once a day.

What type of graphs?

  • General graphs - listing of projects, total number of available hits and rewards for every hour
  • Top 1000 requesters - sorted according to cumulative rewards
  • Arrivals - number of new projects, available hits and rewards computed on daily basis
  • General data
  • Top 1000 requesters
  • Requester details