Welcome to MTurk Crowd

Work on Amazon Mechanical Turk, learn from the best, and have fun doing it. Join the crowd today!

Sign Up

Turkopticon 2.0 beta

Discussion in 'MTurk Help & Resources' started by electrolyte, Mar 22, 2017.

  1. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    19,184
    Likes:
    45,938
    Collapse Signature Expand Signature
  2. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    20,501
    Likes:
    59,963
    I like this, but what I'm wondering is if old reviews are going to be imported? I think there's a lot of valuable content and info in all the old reviews. Wonder if @six@six will pop in?
     
    Collapse Signature Expand Signature
  3. Jaded

    Jaded
    Expand Collapse
    The real themildone

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    42,482
    Likes:
    109,763
    I think if they can't be imported (for whatever reason) that it would be nice to have a link or a notice that says "this requester had previous reviews." That's all dependent on old TO staying up though so this suggestion may not be useful.

    I like the new version.
     
    Collapse Signature Expand Signature
    Yatagarasu likes this.
  4. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    Hi @kryssyy@kryssyy!

    We've talked about this and people have brought this up already but we haven't made a decision yet basically because it's not obvious how best to import the old reviews. To be honest it's not clear if it's even really possible.

    The review format is totally different: reviews are for HITs and not requesters; there are no numerical ratings but instead just questions about pay, time, whether you got paid, etc. So yeah, it's not clear.

    You can however run both scripts at the same time, so while that's maybe a bit annoying, that might be one way to solve the problem until there are a lot of reviews in the new format.

    But yeah, basically we don't have a really good answer to this problem and I'm open to thoughts.

    Edit:

    Oh, actually, @Jaded@Jaded's post reminded me: we did talk about adding the old ratings into the new extension - that's definitely possible too, if people run into problems running both at the same time.
     
    #4 six, Mar 22, 2017
    Last edited: Mar 22, 2017
    Mr. Krabs, kryss and Jaded like this.
  5. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    19,184
    Likes:
    45,938
    Psst. @six@six needs an avatar!
     
    Collapse Signature Expand Signature
    kryss likes this.
  6. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    Yeah I noticed that...
     
    electrolyte likes this.
  7. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    20,501
    Likes:
    59,963
    Is there a way to have both on the new site. Reviews by HIT and reviews by requester or is that getting away from what you're looking to do?

    I've never really cared too much about the ratings or ratings of specific HITs, but more so the content of the reviews. Such as, does the requester block for ambiguous reasons.

    There's so much great content on the .edu site. Using both definitely solves that and it would be a non-issue if the .edu is going to stay up.
     
    Collapse Signature Expand Signature
  8. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    19,184
    Likes:
    45,938
    I guess that's another question: is the original Turkopticon going to stay up indefinitely (and I assume be frozen for new reviews at some point in time)?
     
    Collapse Signature Expand Signature
    kryss likes this.
  9. Kadauchi

    Kadauchi
    Expand Collapse
    Well-Known Member

    • Crowd Pleaser
    • Master Pleaser
    Joined:
    Jan 12, 2016
    Messages:
    6,660
    Likes:
    20,372
    @six@six is the api available for the beta site yet?
     
  10. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    Yes, it will definitely stay up! :)

    We don't even have any sense of when we might close it to new posts. My understanding is that we will definitely keep it up and running as normal until we have a sense that people are getting everything they really need from the new site. If things go well with the new site we will probably close the .edu site to new reviews at some point but we have no plans to take it down completely. The script/extension associated with the .edu site should also continue to display the average ratings from there indefinitely.
     
    jenaling, kryss and electrolyte like this.
  11. Kadauchi

    Kadauchi
    Expand Collapse
    Well-Known Member

    • Crowd Pleaser
    • Master Pleaser
    Joined:
    Jan 12, 2016
    Messages:
    6,660
    Likes:
    20,372
    nvm, ill just get it from the new to script.
     
  12. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    Hi @Kadauchi@Kadauchi! Yes. It is up at https://api.turkopticon.info and it is used by the new user script. feihtality rewrote the API completely though so I can't tell you right now what all information you can get out of it because I don't myself know. He has put a ton of unpaid work into this new version already and I want to be respectful of his time but if documentation of the new API would be useful for you we can ask him if he might be able to put some together.
     
  13. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    :)
     
  14. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    Signing off for now, back on in a couple hours. :)
     
    kryss and electrolyte like this.
  15. ffffffeiht

    ffffffeiht
    Expand Collapse
    New Member

    Joined:
    Mar 22, 2017
    Messages:
    1
    Likes:
    3
    @Kadauchi@Kadauchi apparently I can't add links until i have three posts, but documentation is up at /docs/api. There's a link to everything in the footer of each page.
     
    jenaling, Jaded and kryss like this.
  16. six

    six
    Expand Collapse
    New Member

    • Site Representative
    Joined:
    Sep 7, 2016
    Messages:
    13
    Likes:
    16
    I will pretend like I am being useful and use my link pasting ability:

    https://turkopticon.info/docs/api
     
    electrolyte and Jaded like this.
  17. toutils

    toutils
    Expand Collapse
    New Member

    Joined:
    Mar 23, 2017
    Messages:
    4
    Likes:
    4
    This isn't exactly related but I'm going to be releasing the turkopticon database in a few days. I want to give users a chance to opt out their ids if they want too, I don't know any better way to handle it. The thread on it is in the userscripts/extensions sub.
     
    T. Leela likes this.
  18. electrolyte

    electrolyte
    Expand Collapse
    The Ghost of MTurk Past

    • Contributor
    Joined:
    Jan 10, 2016
    Messages:
    19,184
    Likes:
    45,938
    Collapse Signature Expand Signature
    T. Leela, six and Jaded like this.
  19. toutils

    toutils
    Expand Collapse
    New Member

    Joined:
    Mar 23, 2017
    Messages:
    4
    Likes:
    4
    I've been using the new site now a lot and it's a definitely a huge improvement. The new rating system is the way to go for sure.
     
    Kadauchi likes this.