Recipes - Overview

In Dataloop, a Recipe serves as the foundational configuration for annotation tasks. It defines the structure, behavior, and guidelines for how data should be labeled across various domains. Recipes enable teams to standardize labeling processes, improve annotation quality, and accelerate the training of AI and ML models.

Each Recipe encapsulates:

• Ontology (labels and attributes)

• Annotation tools configuration

• Studio settings

• Task-specific PDF instructions

Recipes promote consistency and repeatability by ensuring that annotators follow predefined parameters aligned with the project’s goals.

Types of Recipes

1. Classic ML Recipe

Classic ML is designed for traditional machine learning pipelines and structured data labeling workflows.

✅ Best suited for:

• Computer Vision (image classification, detection, segmentation)

• Natural Language Processing (text classification, entity recognition)

• Audio analysis (speech labeling, transcription)

• 3D/LiDAR data annotation

🛠️ Features and Setup:

• Define hierarchical labels and custom attributes

• Configure annotation tools (bounding box, polygon, keypoint, etc.)

• Set label colors, import/export labels from text files

• Provide detailed PDF work instructions to guide annotators

• Enable rule-based studio configurations to control labeling behavior

• Fully compatible with SDK and automation tools for model-assisted labeling

2. GenAI / Multimodality Recipe

The GenAI/Multimodality recipe is tailored for evaluating and managing responses from Generative AI models and multi-input annotation tasks.

✅ Best suited for:

• LLM-based workflows (prompt-response evaluation)

• Image + Text alignment tasks

• Multimodal data analysis

🧰 Features and Setup:

• Start with ready-to-use templates or design a custom layout

• Define input prompts, responses, and evaluation criteria

• Customize interface for tasks like ranking, scoring, classification, or open-ended assessment

• Support for integrating multiple data types (text, images, audio, etc.) within a single annotation flow

• Ideal for prompt engineering, response quality benchmarking, and human-in-the-loop validation

Recipe and Dataset Association

• Every Dataset is linked to a single Recipe by default.

• During dataset creation, users can:

  • Create a new Recipe (with the same name as the dataset), or

  • Link an existing Recipe to the new dataset.

• This linkage ensures that the dataset has predefined labeling instructions from the outset.

Recipe and Task Configuration

• Annotation and QA tasks derive their configuration from the linked Recipe.

• By default, a task uses the recipe associated with the dataset from which its items originate.

• However, users can override the default recipe during task creation or editing:

  • This enables the same data item to be annotated or reviewed under multiple recipes, each with distinct taxonomies or label structures.

  • Useful for multi-purpose evaluations, A/B workflows, or cross-domain annotation strategies.

Working with Recipes via SDK

Dataloop’s SDK allows developers to programmatically create, manage, and associate recipes within their pipelines.

• You can define ontologies, attributes, tools, and task instructions via code.

• Useful for automating dataset onboarding or syncing recipe configurations across projects.

👉 To learn more, visit the Developers Guide on Recipes.

Create Recipes

Dataloop enables you to create tailored recipes based on your specific task type, offering support for both Classic ML and GenAI/Multimodality workflows.

• About Classic ML Recipe & Create

• About GenAI/Multimodality Recipe & Create

Access Recipe Page

To open the recipe page for a specific Dataset, use one of the following options:

1. From the Project Dashboard:

   1. In the Project Dashboard → Data Management table, click the Recipe icon for the selected Dataset.

2. From the Recipes menu:

   1. Click on the Recipes from the lift-side menu.

   2. Locate/search for the recipe from the list.

   3. Click on the recipe.

3. From Annotation Studios: Click on the Recipe link above the label-picker section.

   1. Or, select the Item tab from the right-side panel.

   2. Click on the Recipe icon in the Item-Info tab,

View Preview of a Recipe

1. Click on the Recipes from the lift-side menu.

2. Locate or search for the desired recipe in the list.

3. Select the recipe. A preview of the selected recipe will appear in the right-side panel, displaying its labels and attributes.