Welcome to MTurk Crowd

Work on Amazon Mechanical Turk, learn from the best, and have fun doing it. Join the crowd today!

Sign Up

Amazon Updated Amazon Mechanical Turk Terms — What’s Changed

Discussion in 'AMT News' started by electrolyte, Oct 18, 2017.

  1. DCI

    DCI
    Expand Collapse
    Active Member

    Joined:
    Jan 14, 2016
    Messages:
    716
    Likes:
    2,549
    DCI cave for sale.

    [​IMG]
     
    jml, YAHU, kryss and 3 others like this.
  2. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    19,506
    Likes:
    56,152
    Thanks @electrolyte@electrolyte!
     
  3. An Island in the Sun

    An Island in the Sun
    Expand Collapse
    Member

    Joined:
    Jul 29, 2017
    Messages:
    435
    Likes:
    1,231
    Reading stuff like that scenario amazes me. I have trouble enough understanding the most basic scripts and stuff and getting it to help me with mturk, so I generally stick to the basic few I understand well enough, like PC now.

    But can someone explain to me what 'storing data' is exactly? I understand now what it is in that scenario of someone somehow going through a whole batch without being logged in to first gather data of the hits, but it also sounds like even more simple users can somehow store data.
     
    scout likes this.
  4. basketcasey

    basketcasey
    Expand Collapse
    Curiouser and curiouser

    • Contributor
    • Mentor
    Joined:
    Apr 29, 2017
    Messages:
    7,748
    Likes:
    20,737
    Collapse Signature Expand Signature
    scout and electrolyte like this.
  5. Sciency McScienceface

    Sciency McScienceface
    Expand Collapse
    Knowledge is both lock & key

    Joined:
    May 1, 2016
    Messages:
    838
    Likes:
    2,246
    "Storing data" means that your are intentionally downloading the contents of a HIT to your computer to use for some purpose other than completing the HIT.

    Is there a specific HIT type or scenario that you are concerned about?

    Here's some more simple examples of storing data that is prohibited...
    1) If you are validating a grocery store receipts for 411Richmond or Ibotta, and you right-click and save the image of somebody's receipt to your computer... (Technically, the image is already being saved to your computer as a temporary file, but Amazon knows this and doesn't care.)
    2) If you are taking a survey with a hypothetical scenario and you copy/paste the contents of the survey into a Word document on your computer to save it for later. (Keep in mind, some surveys discourage even temporarily copy/pasting text... But I've encountered other surveys where they encourage keeping notes, including copying text... However, the understanding is that the notes taken are not saved for later usage or shared with others)
    3) If you are working on a survey containing embedded videos (those not hosted on YouTube) and you save those video to your computer to watch outside of working on the HIT.

    Keep in mind that all content that you are seeing on your computer screen during any HIT is technically already stored on your computer, but usually as a temporary file. This is 100% okay. This is like how images, such as logos and headers, from your favorite websites are saved in your browser's cache so that when you view those websites again, the website loads slightly faster. If you've every completed a HIT with an embedded PDF, then that PDF is automatically stored somewhere on your computer as a temporary file. Again, that's 100% okay because that's how internet browsers work...
     
    Collapse Signature Expand Signature
    #45 Sciency McScienceface, Oct 19, 2017
    Last edited: Oct 19, 2017
    An Island in the Sun and Lenna15 like this.
  6. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    16,169
    Likes:
    38,320
    I think the scenario that has come up the most related to the "storing data" part has been about scripts, such as HIT Database and MTurkSuite, that store information from the site.

    I will get clarity on this on Friday.
     
    Collapse Signature Expand Signature
    <Gucci>, scout, Lenna15 and 2 others like this.
  7. Sciency McScienceface

    Sciency McScienceface
    Expand Collapse
    Knowledge is both lock & key

    Joined:
    May 1, 2016
    Messages:
    838
    Likes:
    2,246
    Thanks! Also, please do take a pictures when you visit MTruck HQ (if they are cool with it), as others have asked you. It would be fun to see some of the wizards behind the curtain.

    So those scripts you mention are simply store meta-data from the HITs... Not storing any of the actual content of the HITs themselves, right? I don't actually use either, as I write all my own scripts.

    Regardless, most of the contents of all surveys (e.g. completion code page) are technically saved in everybody's browser cache, whether they realize it or not. So again, I really think that the people who should be worried are the ones who KNOW they are doing something dishonest and prohibited.
     
    Collapse Signature Expand Signature
    electrolyte, Cara and scout like this.
  8. scout

    scout
    Expand Collapse
    Active Member

    Joined:
    Jan 15, 2016
    Messages:
    571
    Likes:
    1,036
    Thank you very much for all you do and for sharing it with us. When I saw the update this morning I was really worried (mostly about things like HDB and MTSuite that I use mostly just for analytics because I cannot remember all hundreds of thousands of HITs I have done. Your update is very reassuring. :)


    Thank you for further clarification. This is always kinda what I gathered from the TOS/guidelines before, but the way you explained it made it all the more clear for me. I don't do things like that (not smart enough to do it even if I wanted to haha) so I am very relieved to see y'all updating with clearer descriptions of acceptable script usage. I was too worried to use any of my scripts today until I read this thread. :)
     
    <Gucci>, electrolyte and Cara like this.
  9. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    16,169
    Likes:
    38,320
    Hello! I have a few more clarifications and other things from my meeting today:
    • I'll reiterate what I said earlier about concern about using scripts. You're fine unless you're doing something you know is wrong, like scamming or running scripts that are so powerful that they're damaging the website or causing problems for other workers. Me running HIT Scraper to search for HITs I want to do isn't nearly enough to break MTurk or cause other problems, so things like that are fine.
    • I did ask about HIT Database and similar scripts that save/store information on the worker's computer. I would not be worried about that.
    • If a worker is doing something that raises a red flag at Amazon, you're not going to be outright suspended immediately. They will send a warning email (the one that says "we've noticed unusual activity with your account"). If you send an email back and ask what the problem was, they will tell you exactly what they noticed and what the concern is. They should not be replying with a generic "you just violated the participation agreement" type of email and should be saying exactly what the problem was that they noticed. If you get an automated or unhelpful response to your inquiry, please tell me and I will follow up because that should not be happening now.
    • There was a question about whether the part of the new Participation Agreement that says "you will use your human intelligence and independent judgment to perform Tasks" means you can't talk to other workers. It means you can't share answers, as in you can't share completion codes or tell people how to respond in surveys or what to submit as answers. This is the same as before, and stuff we wouldn't allow on the forum, either.
    • Some workers have been mentioning over the last few days that they've been getting signed out of the new site when they sign into the old site, or vice versa. If that's happening, it's a bug. If this is still happening for you, please send me a PM with whatever details you're comfortable with me sharing (worker ID, what you were doing when it happened, screenshots, etc.) and I'll get them to the team.
    Two other things:
    • The new Participation Agreement says "you will not reject Tasks performed by Workers without good cause" which means Requesters who reject without good cause are in violation of the Participation Agreement.
    • The new Acceptable Use policy says requesters cannot "knowingly publish HITs that Workers will be required to return after accepting them". This means requesters that post a batch and tell workers they don't accept N/A or that they should return HITs that are not found are in violation of the Acceptable Use policy.
    If you find a requester rejecting without good cause or asking workers to return HITs that can't be found, you can point out to the requester that they are acting in violation of the Participation and/or Acceptable Use policies. This will hopefully have more weight than just telling requesters that doing those things sucks for workers.

    I hope that helps! :)
     
    Collapse Signature Expand Signature
  10. Jharkan

    Jharkan
    Expand Collapse
    Internets EXPERT

    • Contributor
    Joined:
    Jul 9, 2016
    Messages:
    8,683
    Likes:
    14,199


    • wow, that applies to 19 of my 23 rejections, since each of them said that they didn't know how to reverse a rejection, and all of them paid me through bonus
     
    Collapse Signature Expand Signature
    scout likes this.
  11. Pleco

    Pleco
    Expand Collapse
    Rum connoisseur

    • Contributor
    • Crowd Pleaser
    Joined:
    Jan 23, 2016
    Messages:
    17,459
    Likes:
    68,388
    If this means better communication from Mturk from now on regarding suspensions, this is the best news from them in a while.
     
    scrmcasey, jan, kryss and 7 others like this.
  12. catnapped

    catnapped
    Expand Collapse
    Well-Known Member

    • Contributor
    • Crowd Pleaser
    • HIT Poster
    Joined:
    Jan 13, 2016
    Messages:
    20,870
    Likes:
    42,907
    That's certainly interesting. Of course won't stop them from stomping off in a huff when you mention it to them but it's a start.
     
    kryss, scout, Jaded and 2 others like this.
  13. Kratrina

    Kratrina
    Expand Collapse
    New Member

    Joined:
    Oct 20, 2017
    Messages:
    2
    Likes:
    6
    Thanks for the info.
     
  14. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    16,169
    Likes:
    38,320
    I'm hopeful. It sounds like they really want to do better and be better and I'm willing to give them the chance.
     
    Collapse Signature Expand Signature
    scrmcasey, Kallee, Serial Mom and 4 others like this.
  15. sryan66611

    sryan66611
    Expand Collapse
    Well-Known Member

    • Contributor
    • Mentor
    Joined:
    Feb 13, 2016
    Messages:
    3,030
    Likes:
    4,961
    so what happens if a requester doesn't want to follow the rules for the things you just posted?? I have a feeling VRapi is not going to follow the rules and still keep telling you to return the address/addresses that you didn't find.
     
    Kathryn, Kallee, SweetiePuff and 5 others like this.
  16. catnapped

    catnapped
    Expand Collapse
    Well-Known Member

    • Contributor
    • Crowd Pleaser
    • HIT Poster
    Joined:
    Jan 13, 2016
    Messages:
    20,870
    Likes:
    42,907
    :thinking:

    Interesting point....
     
    Kathryn, kryss, Jaded and 3 others like this.
  17. sryan66611

    sryan66611
    Expand Collapse
    Well-Known Member

    • Contributor
    • Mentor
    Joined:
    Feb 13, 2016
    Messages:
    3,030
    Likes:
    4,961
    yea its going to be interesting to see what he does... If anyone brings it up to him.
     
    Kathryn, kryss, Jaded and 2 others like this.
  18. Evergreen Queen

    Evergreen Queen
    Expand Collapse
    A very rich widow with a terrible secret.

    • Contributor
    • HIT Poster
    Joined:
    Jun 18, 2017
    Messages:
    3,330
    Likes:
    8,271
    Thanks so much for the info!
     
    Collapse Signature Expand Signature
    Jaded, electrolyte and <Gucci> like this.
  19. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    16,169
    Likes:
    38,320
    Same as any other requester who violates TOS. We can point it out to them. Some requesters are receptive and say they had no idea and fix whatever they're doing wrong because they don't want to violate TOS of a site they're using. Others just don't and won't care. But at least now we have this to point to. We didn't have anything like that before.
     
    Collapse Signature Expand Signature
    Kathryn, kryss, Turtlefemm and 6 others like this.
  20. Achilles2357

    Achilles2357
    Expand Collapse
    Member

    Joined:
    May 24, 2017
    Messages:
    486
    Likes:
    728
    This is really starting to sound like a win to me. No sane person, at least in the US, is going to spend much time working for $2/hr, and the viability of mturk seems to hinge on workers finding ways to do much better than that. I suspect the Amazon side of mturk recognizes that, to some degree or even a considerable degree. But if they are promising "human intelligence" to requesters then they have to make a reasonable effort to ensure that this is what requesters get. This doesn't mean requesters have to get it in exactly the way they anticipate, but I accept that Amazon should strive to assure they get it somehow. My hope is that the Amazon side of mturk will endeavor to use "human intelligence" in making decisions regarding anyone, workers or requesters, who seems to deviate from expectations. It sounds like they might be aiming for that. Maybe we can all win.
     
    Collapse Signature Expand Signature
    kryss and electrolyte like this.