Assignments

Overview

When an annotator logs into the Dataloop platform, their initial screen is the assignment page, where all their assignments in the project are listed.
Annotators can then double-click an assignment to begin work, as this will open the relevant annotation studio with the next item to work on.

Main Sections of Assignment Tab

The Assignment tab can be broken down into the following sections (marked on the screenshot), as outlined below:

Section 1: Create Task and Refresh Buttons

• Create Task: To create a Labeling or a QA task, click on the Create Task button. For more information, see the Annotation and QA tasks article.
• Create Labeling Workflow: To create an Annotation or a QA task using the pipeline, click on the dropdown arrow -> Create Labeling Workflow option.
• Refresh button: To refresh the list of tasks, assignments, or issues, click on the Refresh button.

Section 2: Search and Filters

The Assignment tab enables you to search and filter the assignments. You have the flexibility to choose multiple filter criteria.

Search

The Assignment tab enables you to enter the following search criteria to search assignments in the Search field. To search an assignment, utilize the following criteria:
* Assignment Name: This displays the assignment with the matching name.
* Task ID: This lists assignments based on the task ID of the assignment. You can either use the Copy Task ID icon next to the Task Name or use the URL to get the Task ID.

After entering the search criteria, you can begin the search by either pressing the Enter (or Return) key or by clicking outside the Search field.

Filter

The Assignment tab enables you to use the following filter criteria to filter assignments, when you click on the Select filters the following filter criteria will be listed:

• Select the Assignment's Username from the Select user dropdown list to filter the assignments and issues. After you select the filter criteria, the system initiates the search function.
• Clear Filters: To clear the search or filter criteria, click on the Clear Filters button.

Section 3: List of Assignments

The Assignments tab displays a table listing all assignments, with detailed information in each column. Clicking on an assignment's name directs you to its corresponding item's page. When filtered by username, the selection persists even after reloading or refreshing the platform.

• Users: This displays the avatar of the assignment's users.
• Assignments: This displays the name of the assignments. Use the Copy Assignment ID icon next to the assignment name to copy the Assignment ID.
• Type: This displays the task type, labeling or QA tasks.
• Status: This displays the status of the assignments.
• Priority: This displays the assignments' with a High, Medium, or Low priority.
• Progress: This displays the item's completion status.
• Open Issues: This displays the number of items with annotations that have open issues.
• For Review: This displays the number of items with annotations that have issues corrected for review.

You can customize the visibility of the column fields in the table view by clicking on Show/Hide Columns.

Section 4: Assignment Actions

When you click on a task or an assignment, the Assignment Actions action button is available on the right-side panel of the labeling tasks page, and the following list of actions displayed:

• Clear Batch | This allows you to clear the assignment batch of the tasks which are pulling tasks. |
• Load Batch | This allows you to load the assignment batch of the tasks which are pulling tasks. |
• Open Assignment Browser | This allows you to open and view the assignment browser page. |
• Open Assignment Analytics | This allows you to open and view the Analytics page of the assignment. For more information, see the Analytics article. |
• Reassign: This allows you to reassign the task to a new user.

Section 5: Assignment Details

When you select an assignment, the right-side panel of your Assignment tab displays comprehensive information regarding the selected assignment:

General Details

The General Details section of the assignment provides you the following general information:

• Browser icon: This allows you to open and view the assignment browser page.
• Analytics icon | This takes you to open and view the Analytics page of the assignment.
• Task Name: This displays the assignment name. You can click on it to navigate to the assignment browser page.
• User: This displays the avatar of the assignment's users.
• Priority: This displays the assignments with a High, Medium, or Low priority.
• Channel: This displays the channel type used to create the tasks, Pipeline or Workflow.
• Created At: This displays the assignment creation date, for example, Sep, 15 2023.
• Updated At: This displays the assignment update date, for example, Sep, 15 2023.
• Description: The description provided for the selected assignment's task. To add a description, click on the Edit icon. You can also use SDK to add or edit description.

Use the Copy Assignment ID icon next to the assignment name to copy the Assignment ID.

Status

The Status section of the assignment provides you the following information:

Progress: This displays the item's completion status.
Open Issues: This displays the number of items with annotations that have open issues.
For Review: This displays the number of items with annotations that have issues corrected for review.

Metadata (Read Only)

This section of the assignment provides you the metadata information of the selected assignment. You have the option to copy the metadata, but editing it is not possible.

For example,

{
  "system": {
    "datasetId": "64a671e0d854daf23d6ed2b9",
    "taskId": "65091cc7d93bfc635d4f1878",
    "active": true
  },
  "datasetId": "64a671e0d854daf23d6ed2b9"
}

Section 6: View the Number of Tasks, Assignments, Issues, and Reviews

The Labeling Tasks page provides you the number of Tasks, Assignments, Issues, and Reviews available. You can view the following information on the top-right side of the Labeling Tasks page.

Assignment Progress

Task managers track and review assignment progress.

1. From the Workflow->Assignments menu, Project Assignments lists all the assignments in the project with their progress and allows filtering by specific assignees to review and control their workload.
2. From the tasks page, double-click a task to view the task assignment.
3. Track your task process in one of these two ways:
   1. View the discarded items in the dataset browser.
   2. Open the assignment analytics page (from task assignments).
4. Review discarded and completed items by browsing a task and filtering accordingly.

Reassigning tasks

When a task is active, changes in the workforce can occur. Use this option to reassign an assignment from one annotator to another.

Distribution Task Reassignment

Changes in team structure when using distribution-based tasks use the reassignment and redistribution actions. For example, if an assignee leaves the project and work needs to be reassigned to someone else.

Reassign a Task

To reassign a task, follow the instructions. Ensure you have the Annotation Manager role.

1. Open the Workflows -> Tasks page from the left portal menu.
2. Identify the task and click on the Ellipsis icon.
3. Click Edit task. The edit task page is displayed.
4. Select the Assignments section.
5. Identify the user to whom you need to reassign and click Reassign.
6. Search for or identify the user from the list and click Select Assignee.
7. Click Apply Reassignment.
8. Click Save Changes.

Reassign an Assignment

1. Open the Workflows -> Tasks page from the left portal menu.
2. Double-click on the task and click on the Ellipsis icon.
3. Click Reassign. A Reassign Assignment page is displayed.
4. Search for or use the filter to view available users.
5. Identify the user and click Select Assignee.
6. Click Apply Reassignment.
7. Click Save Changes.

Redistribute a Task or an Assignment of a Task

To remove a specific assignment and have its items distributed among active assignees. For example, if an assignee leaves the project:

To redistribute a task

1. Open the Workflows -> Tasks page from the left portal menu.
2. Click on the Ellipsis icon and select Edit task.
3. Select the Assignments section from the list.
4. Identify the user to be redistributed and click Redistribute. A Redistribute Assignment page is displayed.
5. Select Available Users from the list and add them to the Assigned Users list, if needed.
6. Click Redistribution Settings.
7. Edit the following options and click Save Changes:
   1. Auto Distribution
   2. Only redistribute items with no annotations: This option is to keep the work already started in the original assignment and let the assignee complete it.
   3. Redistribution Context: Redistribute items with a specific Metadata Key/Value or with a DQL Query. It redistributes items to the assignees based on the specific context of their workload.
      1. Metadata Key/Value:
         1. Data type: String or Number
         2. Key and Value
      2. DQL Query
8. Click Apply Redistribution.
9. Click Save Changes.

To redistribute a specific assignment of a task

1. Open the Workflows > Tasks page from the left portal menu.
2. Double-click on the task and click on the Ellipsis icon.
3. Click Redistribute.
4. Refer to the To redistribute a task section and follow steps 5 onward.

Edit the Workload of Pipeline Distribution Task

You have the ability to adjust the workload distribution of incoming pipeline items in distribution-type tasks generated by the pipeline ('My Task' node).

1. Open the Workflows > Tasks page from the left portal menu.
2. Find the pipeline task and click on the 3-dots.
3. Select Edit Task from the list.
4. Select the 5. Assignments section from the left-side menu.
5. Click on the Edit next to the % Items Workload column.
6. Select available users and add them into the Assigned Users list.
7. Click Confirm Workload.

Add Contributors to a Distribution Type Qualification Task

1. Open the Workflows > Tasks page from the left portal menu.
2. Find the pipeline task and click on the 3-dots.
3. Select Edit Task from the list.
4. Select the 5. Assignments section from the left-side menu.
5. Select available users and add them into the Assigned Users list.
6. Click Apply Reassignment.