Abduction annotation

Sign in with the name and password you were given.

saved

Tip: the same image without the box is shown below this one.

the photograph, with one region marked by a pink box

We put the raw image here so you can see the scene without the clue box.

the same photograph without the box
Which statements does the pink box support best?

Mark the most plausible statement 1st and the second most plausible 2nd.

Search words that you don't know. It is important for you to understand every choice's meaning in detail. Do not rush. Check the image and the box, and read each choice carefully.

How sure are you?
Note (optional)
Pick a statement to continue.

All answered

Thank you. Everything was saved as you went. You can close the page.

Admin

Pipeline check (SWiG validation)

Admin only. Each case is a place where the automatic pipeline disagrees with SWiG's human label (verb, frame or filler). Look at the image and answer: is the pipeline's value also a correct description of this image? Answers save at once.

Loading…

Annotators

Download every annotation as JSON

Agreement

Question by question

A bold green number is the intended answer. An empty cell means that annotator has not reached the question.

Notes and flags

Edited distractors (round 3)

One Qwen pass saw each question with its gold, named any other option as plausible for the box, and rewrote it. An edited option shows the old text struck out, then the new text and Qwen's reason. Each model answered the original and the edited question in the same run. A green number is the gold.

Loading…