Recipe - Labeling Instructions

Overview

The Instructions section of the recipe page is meticulously designed to guide users through the setup and use of various tools and features essential for crafting digital recipes. This includes modules for labeling tools, which help in the accurate categorization and organization of ingredients and preparation steps; and tool-specific extensions like pose-tool templates for visualizing the presentation.

Tool Selection

By default, a recipe does not include any specific tools, and the annotations' studio will present all tools. When selecting specific tools in the recipe, they will be presented in the annotation studio accordingly.

1. Open the Select tool drop-down.
2. Click any tool to add it to the recipe.
3. To remove a selected tool, click the (-) icon next to it.

Filter Specific Labels

Selected tools are associated with all labels. To change that, open the drop-down and select the specific labels.
Like, in this example, you will only be able to use the classification tool for the Tomato label.

Recipe Settings

Global Settings

The settings section includes parameters that affect annotation work by enabling specific features:

• Default studio opacity: Set the default annotation opacity level in the different annotation studios. Every new annotation session will start with this default opacity, opacity level adjustments made in the annotation studio will survive between items in the same session only.

• Label Picker - Allow selecting only leaves: By default, allows you to select every level of the tree labels. For example, the label tree structure is vehicle.car.ford, all three (vehicle, vehicle.car, and vehicle.car.ford) can be used as a label. Check this option to allow selecting only leaves, for example, only vehicle.car.ford can be used as a label.

• Enforce 100% segmentation: When enabled, annotators performing semantic segmentation cannot move to the next item until all pixels have been segmented (see Enforce 100% segmentation on Semantic page).
  For their convenience, the unmasked pixels tool helps them find even a single unmasked pixel, anywhere in the image.

• Draw arrowhead on Polyline/Polygon: Check this to add arrowheads on your Polyline/Polygon annotations (see Polyline on Create a Polyline Annotation and Polygon on Creating Polygon Annotation pages).

• Enforce Polyline/Polygon point-reduction granularity: When enabled, polygon/polyline points drawn in free-hand mode are reduced by the value defined here. Annotators do not have the option to override the reduction value set here.

• Allow Polyline/Polygon point-reduction granularity in studio: When enabled, annotations can set the polygon/polyline point reduction factor from the general settings in the studio settings.

• Allow FaaS in the Studio: Uncheck this option to remove the option to use automation in the studio (see AI Automatic Tools on AI Automatic Tools).

• Do not stretch to fit the screen: Check it to open Images in the Original Resolution. This is often required for low-res/small images display.

• Enable pixel smoothing: By default, images are smoothed for softer, easier to work with, edges. For some projects, such as with low-resolution images, this is redundant.

• Keep Zoom and Position: Check this to maintain zoom level and position between images (see General Settings on Image Guide).
  You can also change this setting from the studio.

• Allow next item only on done: Check this to lock the move between items unless they are "done". (see item status on Actions and Statuses).

• Use assignment browser for bulk classification: Select this option to route annotators to the assignment browser when double-clicking their assignment, rather than to the annotation studio.

• Require confirmation before item status update: Select this option to get a confirmation popup before you make a status update on the item.

• Warn when setting status on items with no annotations: By default, a warning message is displayed when you set status on items with no annotations. Check this option to disable it.

• Allow editing of a prompt response in the RLHF studio: It allows annotators to edit responses in the Prompt (RLHF) annotation studio.

• Paragraph delimiter: Click to set a paragraph delimiter for the text annotation.

Annotation Controls

• Object Id: Numbering system that allows annotators to assign a unique object ID to each annotation. Although annotations have their unique annotation ID, this provides a human-friendly annotation numbering and the option to keep track of identical objects between different images. Uncheck it to eliminate the option to add an object ID.

• Auto Assign Object Id: Assigns a unique object ID to every annotation, saving the need for manual entry. The first annotation will get object-ID 1 and continues to increment from there. However if you manually set it to any other number, it will continue to increment from the new value. Uncheck it to eliminate automatic object IDs for every new annotation on an image or video item.

• Parenting: Annotators can create parenting relations between multiple ‘child’ annotations and a ‘parent’ one. Annotations can be ‘child’ and ‘parent’ at the same time. Parenting relations are displayed in the studio as wires over the image and in the annotations list. Uncheck it to eliminate the option to add entity relationships.

• Allow Box Rotation: Check this option to rotate the Box annotations. For more information, see the Box Rotation.

• Allow Cuboid Rotation: Cuboid annotations can be rotated. If not needed, hide this extra functionality by unchecking this option (see Cuboid on Create a Cuboid Annotation).

• Enable automatic conversion of SAM Segmentation to Polygons: Check this option to enable automatic conversion of SAM Segmentation to Polygons.

• Allow bulk attributes update without single-label validation: This option allows you to bulk-select annotations from different labels to update their attributes. When you select multiple annotations from different labels, the empty attribute is replaced with the one that gives the option for bulk attribute updates. Only attributes that match the scope of each selected annotation will apply the change effectively.

OCR Annotation Mode

For text transcripts from images and OCR projects, the OCR mode enables inputting text for every box and polygon annotation created. To learn more, refer to the OCR section.

Annotation Filtering

Enabling these settings in the recipe will filter annotations downloaded to the annotation-studio application based on the option selected. Annotations are filtered on the server side, and for the end-users, they simply don't exist. This allows hiding annotations from annotators, to focus them on their mission or to hide ground-truth annotations.

• Task scope: When enabled, the annotation studio only loads and shows annotations created in the context of the current task. When opening an item, if it's an annotator working on an item in an assignment, or an annotation manager reviewing work in the task, only the annotation created in that task will be loaded and shown. This allows breaking large, complex annotation tasks into smaller, focused sub-tasks, without showing work being done in other tasks at the same time.
• Recipe scope: When enabled, the annotation studio only loads annotations that match the currently used recipe. This can be used, for example, to load and show in QA review tasks only specific annotations that need to be reviewed.

Video Settings

The following settings affect video annotation work.

• Enable Interpolation: When checked, object interpolation between frames will be enabled in the video annotation studio.
• Interpolation ON by default: When enabled in the previous option, checking this option will set interpolation ON by default, and won't require the annotator to manually enable it first.
• Enforce label & attribute value to entire annotation: When enabled, changing a label or attribute value on any frame in an annotation will apply the value to the entire annotation, rather than creating a key-frame where the change occurs.
• Ignore WebM Video Warnings: Enable this option to bypass WebM video warnings and errors, allowing annotation on non-WebM files. Using any tool other than the Classification tool for unconverted videos may result in inaccurate results.

Pose Annotation Template

When the Point tool is enabled from the Tools-Selection, a pose template can be created to enable Pose Annotations.

1. Click Create, write a name, and click enter to create a new template.

2. Click the Ellipsis icon on the right of the template, and then click Edit Template.

3. Select keypoints from the label list on the left and click a position on the canvas to create a pose template. Note that the order of keypoints is documented on the Label order list on the right.
4. To add lines between the keypoints, switch to Add lines on the top bar and start dragging lines between keypoints. Notice that the label connections of lines are documented on the Arcs list on the right.
   1. Use the Line suggestions tool to add lines quickly.
   2. Use Show Labels Chips to show the keypoints label name.

Annotation Instructions

With Dataloop, you can upload and view your latest annotation instructions PDF document directly in the annotation studio.

QA Instructions

With Dataloop, you can upload and view your latest QA instructions PDF document directly in the annotation studio.

Annotation Verification (JS Scripts)

Uploading a JavaScript file in the recipe settings will trigger the script when pressing the COMPLETE button during annotation work. The JS can enrich annotation studios with rules enforcement, such as:

1. Labels coexistence (for example, cannot have more than 3 annotations with a specific label)
2. Cross label and attributes rules (for example, if there's an annotation from label A with Attribute X, cannot co-exist with the Annotation from label B with attribute Y)
3. Tool-specific rules (for example, a point must be within the boundaries of a box)