Welcome and thank you for your participation!

Instructions and Examples

The main purpose of this task is to get your feedback on the quality of the provided instructions below. We use this feedback to improve the quality of the provided instructions for the next round. Please read the instructions and tells us what you think. You can tell us about: (1) typos (2) ambiguous or odd phrasings (3) what can be added/changed to make the task easier to understand. Feel free to be as critical as you want about the instructions.

Instructions: {{instructions}}


Positive (Desirable) Examples

Here are examples of desirable behaviors for this task:

Negative (Undesirable) Examples

Here are several negative examples (undesirable outputs) for this task:

Great! You are now ready to start the following examples!


Your Task


First, please tell us how we can improve the above instructions. We expect you to provide suggestions to improve the instructions for every few HITs. So, please do not leave them empty all the time. If the instructions are impeccable, leave the boxes empty (and avoid unconstructive feedback such as "it's good", "nothing", etc.)


Instruction quality:
Q1: What did you think about the quality of the task definition?
(Avoid putting random/garbage text here. Consistent random responses will result in being blocked. Better leave this box empty instead of writing something irrelevant. We bonus those workers with constructive feedback for improving the instructions.)
Q2: What can be improved in the instructions, if any? (please indicate any typos, lack of clarities or any other issues)

Positive examples quality:
Q1: What did you think about the quality of the provided positive examples?
Q2: What can be improved about the positive examples, if any? (please indicate any typos, lack of clarities or any other issues)

Negative examples quality:
Q1: What did you think about the quality of the provided negative examples?
Q2: What can be improved about the negative examples, if any? (please indicate any typos, lack of clarities or any other issues)

Now please answer the following inputs, according to the provided instructions above.

Please direct any comments, feedback, issues or questions to this email address: danielk@allenai.org


]]> 450