Welcome to MTurk Crowd

Work on Amazon Mechanical Turk, learn from the best, and have fun doing it. Join the crowd today!

Sign Up

New Hotel Photo Classification and Moderation HIT signup

Discussion in 'Requesters' started by Cliff DesPeaux, May 22, 2018.

  1. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    Hi all,

    At some point in the next few days I will be posting a new type of hotel photo classification and moderation HIT I am setting up as an initial test. I am hoping to use this thread to recruit workers for a qual group for these HITs, and to be available to answer any questions and solicit feedback before, during, and after the test.

    Guidelines: https://sites.google.com/view/image-review-guidelines/ugc-photo-moderation

    Qual group signup form: https://goo.gl/forms/0dPEHYBipDpB0yaw2

    Please let me know if you have any questions.

    Thanks!
    Cliff
     
  2. Member9

    Member9
    Expand Collapse
    null

    Joined:
    Jan 11, 2016
    Messages:
    177
    Likes:
    122
    Will these be for different qualifications than the ones currently used? Like if I have the current quals should I sign up for this set as well?
     
  3. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    Different qual group and on a different account I use for testing, so please sign up for this one too.

    The reason for this is because these images have different moderation guidelines and I don't want to confuse workers of the existing HITs.
     
  4. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    I am about to post some HITs. I'll be here for questions/feedback.
     
    kryss, YAHU, aveline and 2 others like this.
  5. Barbwire

    Barbwire
    Expand Collapse
    Averagely-known member

    • Contributor
    Joined:
    Jan 12, 2016
    Messages:
    4,051
    Likes:
    6,730
    how many do you recommend we complete?
     
  6. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    20,436
    Likes:
    59,649
    Just curious if this is going to be the same pay structure for the HITS?
     
    Collapse Signature Expand Signature
    Astro and Jaded like this.
  7. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    What do you mean?
     
  8. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    As many as you'd like!
     
  9. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    20,436
    Likes:
    59,649
    Classifying 5 images for .05 per HIT.
     
    Collapse Signature Expand Signature
    Astro and Jaded like this.
  10. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    They are posted with the title "Image Classification and Moderation" (sorry, not sure the best way to link to the HITs directly).
     
  11. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    That's the plan for this test.
     
  12. YAHU

    YAHU
    Expand Collapse
    YAHUUUUUUU

    • Contributor
    Joined:
    Jan 11, 2016
    Messages:
    8,263
    Likes:
    27,190
    What should we do for landmarks, etc.


    Also, will the other hotel photo hits still be posted alongside these?
     
    Jaded likes this.
  13. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    Non-hotel images are allowed in these HITs; the requirements are slightly different vs. the other HITs. And yes, this is an unrelated project from the other HITs.
     
  14. Astro

    Astro
    Expand Collapse
    Zorp The Surveyor

    • Contributor
    Joined:
    Jan 12, 2016
    Messages:
    92
    Likes:
    373
    With all due respect, 5 cents per HIT (.01 per image classification) seems like exceptionally low pay for the amount of consideration and review needed on these tasks. Is this the exact pay structure workers should expect when these are rolled out into fully qualified campaigns?
     
  15. Member9

    Member9
    Expand Collapse
    null

    Joined:
    Jan 11, 2016
    Messages:
    177
    Likes:
    122
    There's no classification/sub-classification to put them under. Those images don't fit in any of the existing categories for what part of the hotel the image is of.
     
    Jaded likes this.
  16. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    Thank you for the feedback! Good info to have. Are there any categories you can suggest to add?
     
  17. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    Thank you for the feedback. What do you think is a more reasonable rate per image?
     
    Astro likes this.
  18. YAHU

    YAHU
    Expand Collapse
    YAHUUUUUUU

    • Contributor
    Joined:
    Jan 11, 2016
    Messages:
    8,263
    Likes:
    27,190
    Exterior -> landmark/attraction maybe so that you dont have to add another overall category
     
    DCI and Member9 like this.
  19. Member9

    Member9
    Expand Collapse
    null

    Joined:
    Jan 11, 2016
    Messages:
    177
    Likes:
    122
    Agreed. This is the existing .08 and .10 HITs combined into one, for way less pay. I don't know very many experienced turkers who would prioritize completing these for the .05 pay when there's plenty of better paying tasks on the platform at any given time.
     
  20. Cliff DesPeaux

    Cliff DesPeaux
    Expand Collapse
    New Member

    • Requester
    Joined:
    Jul 28, 2017
    Messages:
    60
    Likes:
    273
    Would $0.10/HIT make these more desirable?
     
    SherryNotShirley and Michele like this.