Skip to content

docs: DOC-258: Add new reject setting for reviewers #6521

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Oct 16, 2024
Merged
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
81 changes: 69 additions & 12 deletions docs/source/guide/project_settings_lse.md
Original file line number Diff line number Diff line change
Expand Up @@ -201,7 +201,7 @@ Enable **Show before reviewing** to display a pop-up message to reviewers when t

<dd>

Configure additional settings for reviewers.
Configure what is required for a task to be considered reviewed.

<table>
<thead>
Expand Down Expand Up @@ -232,6 +232,74 @@ In a task where multiple annotators submitted labels, the reviewer needs to acce

</td>
</tr>
</table>

</dd>

<dt id="reject-options">Reject Options</dt>

<dd>

Configure what rejection options are available to reviewers.

<table>
<thead>
<tr>
<th>Field</th>
<th>Description</th>
</tr>
</thead>
<tr>
<td>

**Requeue rejected tasks back to annotators**
</td>
<td>

Rejected tasks are reassigned back to the annotator.

</td>
</tr>
<td>

**Remove rejected tasks from labeling queue**
</td>
<td>

Rejected tasks are removed from the queue and not reassigned back to the annotator.

</td>
</tr>
<tr>
<td>

**Allow reviewer to choose: Requeue or Remove**
</td>
<td>

When rejecting a task, reviewers have the option to decide whether the task should be removed from the queue or reassigned to the annotator (placed back in their queue).

For example, a reviewer might decide to requeue a task that is nearly correct but just needs a slight change. But a task with more errors may be easier to simply remove.

</td>
</tr>
</table>

</dd>

<dt id="review-settings">Additional settings</dt>

<dd>

Configure additional reviewer settings

<table>
<thead>
<tr>
<th>Field</th>
<th>Description</th>
</tr>
</thead>
<tr>
<td>

Expand Down Expand Up @@ -276,17 +344,6 @@ However, some information is still hidden from reviewers and they can only view
<tr>
<td>

**Requeue rejected tasks back to annotators**
</td>
<td>

Rejected tasks are reassigned back to the annotator.

</td>
</tr>
<tr>
<td>

**Reviewers must leave a comment on reject**
</td>
<td>
Expand Down